Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Creek

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Andy Kent Andy Kent
October 22, 2011
Programming
86
1

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Avatar for Andy Kent

Andy Kent

October 22, 2011

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
Avatar for Andy Kent andykent
2
88
Coder Dojo London Fireworks
Avatar for Andy Kent andykent
0
130
River JS
Avatar for Andy Kent andykent
2
660
Scalling Node to 50 Million Requests
Avatar for Andy Kent andykent
5
310

Other Decks in Programming

See All in Programming
R8 の設定見直しでアプリサイズ削減
Avatar for ANDPAD inc andpad
0
220
コードレビューのボトルネックを"する側"と"される側"の両面から解消する
Avatar for yub0n yub0n
2
1.6k
動作中のプログラムの中身をリアルタイムに覗く / Realtime Debugger for CSharp with Roslyn
Avatar for Prota prota
1
1.9k
FactoryBotをやめればRSpecは速くなるのか？
Avatar for nissyi yuta_onishi_97
0
330
[Rails World 2026] Durable orchestration on Rails: from continuation to workflow
Avatar for Vladimir Dementyev palkan
1
750
APNsからLive Activityを開始する話
Avatar for Ryotaro Onoue yumnumm
0
170
ChromeでローカルLLM
Avatar for ryu ryu1013
0
140
個人開発者よ、Honoを使え（おじさんver）
Avatar for tanahiro2010 tanahiro2010
2
260
3回つくってわかった、
定期実行ジョブ基盤の本質情報
Avatar for Naoto Takai takai
0
460
Everything will be SERVERLESS — 信じて運用した10年の経験値 / Everything Will be Serverless — Lessons Learned from 10 Years of Operational Experience
Avatar for shiro seike seike460
PRO
1
1.1k
機械に任せるテスト、人が見るテスト ⽣成AIで引き直した、運⽤保守フェーズの線引き
Avatar for KUSATAKE Daisuke dske104
0
190
パズルゲームの作り方 / how to make puzzle games
Avatar for kaityo256 kaityo256
PRO
2
290

Featured

See All Featured
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
39
3.5k
Leveraging LLMs for student feedback in introductory data science courses - posit::conf(2025)
Avatar for Mine Cetinkaya-Rundel minecr
1
440
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
Avatar for Tech SEO Connect techseoconnect
PRO
0
460
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
1.9k
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
74
43k
Lightning Talk: Beautiful Slides for Beginners
Avatar for Ines Montani inesmontani
PRO
2
730
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
430
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
710
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
320
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
96
6.9k
It's Worth the Effort
Avatar for 3n 3n
188
29k
The Hidden Cost of Media on the Web [PixelPalooza 2025]
Avatar for Tammy Everts tammyeverts
2
530

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END