Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creek

Avatar for Andy Kent Andy Kent
October 22, 2011
Programming
1
76

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Avatar for Andy Kent

Andy Kent

October 22, 2011
Tweet

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
Avatar for Andy Kent andykent
2
77
Coder Dojo London Fireworks
Avatar for Andy Kent andykent
0
120
River JS
Avatar for Andy Kent andykent
2
650
Scalling Node to 50 Million Requests
Avatar for Andy Kent andykent
5
290

Other Decks in Programming

See All in Programming
Building, Deploying, and Monitoring Ruby Web Applications with Falcon (Kaigi on Rails 2025)
Avatar for Samuel Williams ioquatix
4
2.5k
ALL CODE BASE ARE BELONG TO STUDY
Avatar for uzulla uzulla
27
6.6k
Foundation Modelsを実装日本語学習アプリを作ってみた！
Avatar for 蛋白（たんぱく・TANPACT） hypebeans
1
120
登壇は dynamic! な営みである / speech is dynamic
Avatar for Daichi KUDO da1chi
0
360
Google Opalで使える37のライブラリ
Avatar for MIKIO KUBO mickey_kubo
3
140
EMこそClaude Codeでコード調査しよう
Avatar for shibayu36 shibayu36
0
360
NIKKEI Tech Talk#38
Avatar for cipepser cipepser
0
180
TransformerからMCPまで（現代AIを理解するための羅針盤）
Avatar for MIKIO KUBO mickey_kubo
7
4.6k
Devoxx BE - Local Development in the AI Era
Avatar for Kevin Dubois kdubois
0
140
Migration to Signals, Resource API, and NgRx Signal Store
Avatar for Manfred Steyer manfredsteyer
PRO
0
100
What Spring Developers Should Know About Jakarta EE
Avatar for ivargrimstad ivargrimstad
0
440
理論と実務のギャップを超える
Avatar for kmuto eycjur
0
180

Featured

See All Featured
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
30
2.9k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
11k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
173
15k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
285
14k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
791
250k
The Language of Interfaces
Avatar for Des Traynor destraynor
162
25k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.3k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
10
610
Faster Mobile Websites
Avatar for Dean Hume deanohume
310
31k
Writing Fast Ruby
Avatar for Erik Berlin sferik
629
62k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
115
20k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END