Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creek

Andy Kent
October 22, 2011
Programming
1
71

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Andy Kent

October 22, 2011
Tweet

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
andykent
2
71
Coder Dojo London Fireworks
andykent
0
110
River JS
andykent
2
640
Scalling Node to 50 Million Requests
andykent
5
290

Other Decks in Programming

See All in Programming
Ruby Pattern Matching
bkuhlmann
0
930
#phpcon_odawara オープン・クローズドなテストフィクスチャを求めて / open closed test fixtures
77web
3
230
ONE WEDGE_company_guide
1wedge_one
0
470
R言語の環境構築と基礎 Tokyo.R 112
bob3bob3
0
270
Anthropic Cookbook のおすすめレシピ
schroneko
7
940
VSCodeでのDatabricks開発もお勧めしたい/I would also recommend Databricks development with VSCode.
kazumain
0
250
FigmaとPHPで作る1ミリたりとも表示崩れしない最強の帳票印刷ソリューション
ttskch
43
19k
冗長なエラーログを削減し、スタックトレースを手に入れる / Reducing Verbose Error Logs and Obtaining Stack Traces
upamune
0
550
2 週間で Twitter Bot を作ってみた
contour_gara
0
370
educure_カリキュラム生操作マニュアル.pdf
linew_official
0
780
MicrosoftのPlatform Engineeringガイドを読んで実際になにかやってみた
ymd65536
1
330
スキーマ駆動開発による品質とスピードの両立 - 私達は何故、スキーマを書くのか
kentaroutakeda
0
170

Featured

See All Featured
Designing Dashboards & Data Visualisations in Web Apps
destraynor
226
51k
Code Reviewing Like a Champion
maltzj
514
39k
5 minutes of I Can Smell Your CMS
philhawksworth
199
19k
The Invisible Side of Design
smashingmag
294
49k
Adopting Sorbet at Scale
ufuk
68
8.6k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
18
6.9k
Principles of Awesome APIs and How to Build Them.
keavy
121
16k
Fontdeck: Realign not Redesign
paulrobertlloyd
76
4.9k
The Cost Of JavaScript in 2023
addyosmani
16
3.9k
Typedesign – Prime Four
hannesfritz
36
2.1k
From Idea to $5000 a Month in 5 Months
shpigford
377
45k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
116
18k

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END