Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Creek

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Andy Kent Andy Kent
October 22, 2011
Programming
1
78

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Avatar for Andy Kent

Andy Kent

October 22, 2011
Tweet

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
Avatar for Andy Kent andykent
2
80
Coder Dojo London Fireworks
Avatar for Andy Kent andykent
0
130
River JS
Avatar for Andy Kent andykent
2
650
Scalling Node to 50 Million Requests
Avatar for Andy Kent andykent
5
300

Other Decks in Programming

See All in Programming
組織で育むオブザーバビリティ
Avatar for ryotaro kobayashi ryota_hnk
0
180
今から始めるClaude Code超入門
Avatar for 448jp | OKI Yoshiya 448jp
8
9.1k
MDN Web Docs に日本語翻訳でコントリビュート
Avatar for uutan1108 ohmori_yusuke
0
650
AI によるインシデント初動調査の自動化を行う AI インシデントコマンダーを作った話
Avatar for azukiazusa azukiazusa1
1
750
コマンドとリード間の連携に対する脅威分析フレームワーク
Avatar for Aja9tochin pandayumi
1
460
例外処理とどう使い分ける？Result型を使ったエラー設計 #burikaigi
Avatar for Takuma Kajikawa kajitack
16
6.1k
CSC307 Lecture 06
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
690
要求定義・仕様記述・設計・検証の手引き - 理論から学ぶ明確で統一された成果物定義
Avatar for Kuniwak orgachem
PRO
1
220
AI Agent の開発と運用を支える Durable Execution #AgentsInProd
Avatar for izumin5210 izumin5210
7
2.3k
20260127_試行錯誤の結晶を1冊に。著者が解説 先輩データサイエンティストからの指南書 / author's_commentary_ds_instructions_guide
Avatar for nash_efp nash_efp
1
990
Data-Centric Kaggle
Avatar for ねぼすけAI isax1015
2
780
AIで開発はどれくらい加速したのか？AIエージェントによるコード生成を、現場の評価と研究開発の評価の両面からdeep diveしてみる
Avatar for どすこい daisuketakeda
1
2.5k

Featured

See All Featured
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
170
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
650
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
450
New Earth Scene 8
Avatar for Sydney Stone popppiees
1
1.5k
Navigating Team Friction
Avatar for Lara Hogan lara
192
16k
[RailsConf 2023] Rails as a piece of cake
Avatar for Vladimir Dementyev palkan
59
6.3k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
67
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
25
1.7k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
2.1k
Designing for Timeless Needs
Avatar for Cassini Nazir cassininazir
0
130
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
9
1.2k
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
120

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END