Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creek

Avatar for Andy Kent Andy Kent
October 22, 2011
Programming
82
1

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Avatar for Andy Kent

Andy Kent

October 22, 2011

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
Avatar for Andy Kent andykent
2
83
Coder Dojo London Fireworks
Avatar for Andy Kent andykent
0
130
River JS
Avatar for Andy Kent andykent
2
650
Scalling Node to 50 Million Requests
Avatar for Andy Kent andykent
5
300

Other Decks in Programming

See All in Programming
AWSコミュニティ活動は顧客のクラウド推進に効くのか / Do AWS community activities help customers adopt the cloud?
Avatar for shiro seike seike460
PRO
0
170
WebAssembly を読み込むベストプラクティス 2026年春版 / Best Practices for Loading WebAssembly (Spring 2026)
Avatar for petamoriken / 森建 petamoriken
5
1.1k
ふにゃっとしない名前の付け方 〜哲学で茹で上げる、コシのあるソフトウェア設計〜
Avatar for akshimo shimomura
0
110
ソースコード→AST→オペコード、の旅を覗いてみる
Avatar for hideki kinjyo o0h
PRO
1
120
過去のレビュー知見をSkillsで資産化した話
Avatar for PKSHA Technology（パークシャテクノロジー） pkshadeck
PRO
1
1.4k
Kingdom of the Machine
Avatar for yui-knk yui_knk
2
1.4k
【26新卒研修資料】TDD実装演習
Avatar for ディップ株式会社 dip_tech
PRO
0
170
2026年のソフトウェア開発を考える（2026/05版） / Software Engineering Scrum Fest Niigata 2026 Edition
Avatar for Takuto Wada twada
PRO
21
11k
リセットCSSを1行消したらアクセシビリティが向上した話
Avatar for pvcresin pvcresin
4
480
実践ハーネスエンジニアリング：ステアリングループを実例から読み解く / Practical Harness Engineering: Understanding Steering Loops Through Real-World Examples
Avatar for nrs nrslib
4
3.3k
AI-DLC Deep Dive
Avatar for yuukiyo yuukiyo
9
5.6k
ローカルLLMでどこまでコードが書けるか / How much code can be written on a local LLM
Avatar for Naoki Kishida kishida
2
310

Featured

See All Featured
Building AI with AI
Avatar for Ines Montani inesmontani
PRO
1
970
The Curious Case for Waylosing
Avatar for Cassini Nazir cassininazir
0
340
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
Avatar for Aleyda Solis aleyda
1
1.2k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
133
19k
DevOps and Value Stream Thinking: Enabling flow, efficiency and business value
Avatar for Helen Beal helenjbeal
1
180
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.4k
Impact Scores and Hybrid Strategies: The future of link building
Avatar for Tamara Novitovic tamaranovitovic
0
270
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
370
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.6k
My Coaching Mixtape
Avatar for mlcsv mlcsv
0
120
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
1
360
How Fast Is Fast Enough? [PerfNow 2025]
Avatar for Tammy Everts tammyeverts
3
560

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END