Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creek

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Andy Kent Andy Kent
October 22, 2011
Programming
1
79

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Avatar for Andy Kent

Andy Kent

October 22, 2011
Tweet

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
Avatar for Andy Kent andykent
2
80
Coder Dojo London Fireworks
Avatar for Andy Kent andykent
0
130
River JS
Avatar for Andy Kent andykent
2
650
Scalling Node to 50 Million Requests
Avatar for Andy Kent andykent
5
300

Other Decks in Programming

See All in Programming
AHC061解説
Avatar for Shun_PI shun_pi
0
410
それはエンジニアリングの糧である：AI開発のためにAIのOSSを開発する現場より / It serves as fuel for engineering: insights from the field of developing open-source AI for AI development.
Avatar for nrs nrslib
1
490
PHPで TLSのプロトコルを実装してみる
Avatar for higaki higaki_program
0
400
What Spring Developers Should Know About Jakarta EE
Avatar for ivargrimstad ivargrimstad
0
770
Vuetify 3 → 4 何が変わった？差分と移行ポイント10分まとめ
Avatar for kouki.miura koukimiura
0
180
Codexに役割を持たせる 他のAIエージェントと組み合わせる実務Tips
Avatar for o8n o8n
4
1.4k
OTP を自動で入力する裏技
Avatar for Megabits_mzq megabitsenmzq
0
120
20260320登壇資料
Avatar for 松井遼(まついはるか) pharct
0
110
ベクトル検索のフィルタを用いた機械学習モデルとの統合 / python-meetup-fukuoka-06-vector-attr
Avatar for monochromegane monochromegane
2
510
new(1.26) ← これすき / kamakura.go #8
Avatar for utagawa kiki utgwkk
0
2.6k
Nostalgia Meets Technology: Super Mario with TypeScript
Avatar for Manfred Steyer manfredsteyer
PRO
0
100
[PHPerKaigi 2026]PHPerKaigi2025の企画CodeGolfが最高すぎて社内で内製して半年運営して得た内製と運営の知見
Avatar for Z.O.E. ikezoemakoto
0
260

Featured

See All Featured
Side Projects
Avatar for Sacha Greif sachag
455
43k
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
Avatar for David Carrasco davidcarrasco
3
82
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
88
5k
エンジニアに許された特別な時間の終わり
Avatar for watany watany
106
240k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
22k
HDC tutorial
Avatar for Michiel Stock michielstock
1
580
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
Avatar for Ines Montani inesmontani
PRO
3
3.2k
Evolving SEO for Evolving Search Engines
Avatar for Ryan Jones ryanjones
0
170
Accessibility Awareness
Avatar for Sarah Abderemane sabderemane
0
84
Color Theory Basics | Prateek | Gurzu
Avatar for Gurzu gurzu
0
260

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END