Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creek

Avatar for Andy Kent Andy Kent
October 22, 2011
Programming
85
1

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Avatar for Andy Kent

Andy Kent

October 22, 2011

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
Avatar for Andy Kent andykent
2
88
Coder Dojo London Fireworks
Avatar for Andy Kent andykent
0
130
River JS
Avatar for Andy Kent andykent
2
660
Scalling Node to 50 Million Requests
Avatar for Andy Kent andykent
5
310

Other Decks in Programming

See All in Programming
言葉の格闘技のススメ～紙とペンと言葉から始める、キャリアの描き方～
Avatar for 進捗ゼミ progresscicada
2
180
思考垂れ流し開発　～音声入力 × AIエージェント × 開発ハーネスによる試行錯誤～
Avatar for NPOS npostring
0
350
生成AIで帳票OCRが「簡単に」作れる時代になった？
Avatar for Shohei Kondo kon_shou
0
1.2k
VibeCodingからAgenticWorkflowへ
Avatar for starfish719 starfish719
0
920
仕様駆動開発の消費期限
Avatar for watany watany
20
9k
高専キャリア LT 発表内容
Avatar for Crysta1221 crysta1221
1
330
プロポーザルを書いてもらう
Avatar for pvcresin pvcresin
0
580
進化を続けるGo toolsの現在地 / The Current State of Ever-Evolving Go Tools
Avatar for hond hond0413
0
270
30年振りにコンパイラの定数整数除算を改善した
Avatar for herumi herumi
9
4.3k
freee が目指す データ マネジメント戦略 AI-Ready 時代を支える 攻めのガバナンスとは
Avatar for freee freee
PRO
0
510
freeeにおけるEvalsの実践例の紹介
Avatar for freee freee
PRO
0
160
Hono + Inertia + React で LP を構築した話
Avatar for Yuka Ooka oukayuka
2
180

Featured

See All Featured
SEO in 2025: How to Prepare for the Future of Search
Avatar for Michael King ipullrank
3
3.8k
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
4.4k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
180
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
1
2.3k
HTML-Aware ERB: The Path to Reactive Rendering @ RubyCon 2026, Rimini, Italy
Avatar for Marco Roth marcoroth
4
500
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
432
67k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
331
25k
Agile Leadership in an Agile Organization
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
210
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
45
9.2k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
41
2.7k
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
560
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
39
3.4k

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END