Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Creek

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Andy Kent Andy Kent
October 22, 2011
Programming
86
1

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Avatar for Andy Kent

Andy Kent

October 22, 2011

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
Avatar for Andy Kent andykent
2
88
Coder Dojo London Fireworks
Avatar for Andy Kent andykent
0
130
River JS
Avatar for Andy Kent andykent
2
660
Scalling Node to 50 Million Requests
Avatar for Andy Kent andykent
5
310

Other Decks in Programming

See All in Programming
AI Agent時代のリアーキテクチャ戦略と実践
Avatar for Kazuhito Hokamura hokaccha
9
4.8k
テストを司るデーモンに会いに行く 〜隔離した仮想マシンでテストを通すまで〜
Avatar for Hidemune Takahashi h1d3mun3
1
450
技術的負債の返済は、AI時代の複利で効く投資 — 経営としての意思決定とその遂行
Avatar for curekoshimizu curekoshimizu
0
1.5k
Jetpack Compose メカニズム
Avatar for Jaewoong skydoves
0
440
App Storeの外へ──日本のiOSサイドローディング入門 for iOSDC Japan 2026
Avatar for 野瀬田　裕樹 yuukiw00w
0
220
そのリトライ、死んだコネクションを使い回していませんか ── GoのHTTPクライアントとHTTP/2を実プロダクト障害から学び直す
Avatar for Yusa Matsuda myus4a
0
150
Snowflakeで業務アプリを作ろう。 Snowflakeのアプリ機能解説&実践ガイド
Avatar for Ayumu Yamaguchi ayumu_yamaguchi
1
280
すこし踏み込む CancellationToken
Avatar for tkym htkym
2
560
XHTMLが残したもの
Avatar for Yosuke Furukawa yosuke_furukawa
PRO
2
820
cdk deploy JawsSonic #MARATHONしながらAWSリソースをデプロイしてみよう
Avatar for アキキー | Akihisa Ikeda akihisaikeda
2
140
Security issues being discussed on Web Platforms
Avatar for petamoriken / 森建 petamoriken
0
970
AI が書く Go コードの品質を劇的に向上させる Linter: “declscope”
Avatar for mpyw mpyw
0
370

Featured

See All Featured
The AI Search Optimization Roadmap by Aleyda Solis
Avatar for Aleyda Solis aleyda
1
6.2k
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
1
570
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
1
34k
<Decoding/> the Language of Devs - We Love SEO 2024
Avatar for Nikki Halliwell nikkihalliwell
1
330
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
192
12k
How to Talk to Developers About Accessibility
Avatar for Jason CranfordTeague jct
2
550
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
Avatar for David Carrasco davidcarrasco
3
240
Accessibility Awareness
Avatar for Sarah Abderemane sabderemane
1
210
SEO Brein meetup: CTRL+C is not how to scale international SEO
Avatar for Linda Hogenes lindahogenes
2
2.9k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.4k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
356
21k
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
510

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END