$30 off During Our Annual Pro Sale. View Details »

Creek

Avatar for Andy Kent Andy Kent
October 22, 2011
Programming
1
78

 Creek

Presentation given at LNUG discussing realtime aggregation over unbounded streams

Avatar for Andy Kent

Andy Kent

October 22, 2011
Tweet

More Decks by Andy Kent

See All by Andy Kent
Coder Dojo London MIDI
Avatar for Andy Kent andykent
2
79
Coder Dojo London Fireworks
Avatar for Andy Kent andykent
0
130
River JS
Avatar for Andy Kent andykent
2
650
Scalling Node to 50 Million Requests
Avatar for Andy Kent andykent
5
300

Other Decks in Programming

See All in Programming
AI Agent Dojo ＃4: watsonx Orchestrate ADK体験
Avatar for Akira Onishi (IBM) oniak3ibm
PRO
0
110
AIエージェントの設計で注意するべきポイント6選
Avatar for Har1101 har1101
5
2.1k
Patterns of Patterns
Avatar for Denys Poltorak denyspoltorak
0
260
Go コードベースの構成と AI コンテキスト定義
Avatar for ANDPAD inc andpad
0
130
「コードは上から下へ読むのが一番」と思った時に、思い出してほしい話
Avatar for HideyukiKitao panda728
PRO
39
26k
AIコーディングエージェント（NotebookLM）
Avatar for kondai kondai24
0
220
Cap'n Webについて
Avatar for Yusuke Wada yusukebe
0
150
The Art of Re-Architecture - Droidcon India 2025
Avatar for Sid Patil siddroid
0
120
Python札幌 LT資料
Avatar for t3tra t3tra
6
1k
AIコーディングエージェント（Gemini）
Avatar for kondai kondai24
0
270
エディターってAIで操作できるんだぜ
Avatar for kis9a kis9a
0
750
LLMで複雑な検索条件アセットから脱却する！！ 生成的検索インタフェースの設計論
Avatar for po3rin po3rin
4
950

Featured

See All Featured
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
52
5.8k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
37
2.7k
Navigating Team Friction
Avatar for Lara Hogan lara
191
16k
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
Avatar for Katarina Dahlin katarinadahlin
PRO
0
3.4k
Kristin Tynski - Automating Marketing Tasks With AI
Avatar for Tech SEO Connect techseoconnect
PRO
0
110
New Earth Scene 8
Avatar for Sydney Stone popppiees
0
1.2k
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
19k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
302
51k
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
0
1.9k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
How GitHub (no longer) Works
Avatar for Zach Holman holman
316
140k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k

Transcript

  1. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  2. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  3. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  4. REALTIME DATA ANALYSIS OVER UNBOUNDED STREAMS

  5. WHEN YOU’VE GOT A HOSEPIPE WHAT YOU WANT IS A

    CREEK

  6. CREEK https://github.com/andykent/creek

  7. AGGREGATORS count.alltime, count.timeboxed distinct.alltime, distinct.timeboxed max.alltime, max.timeboxed mean.alltime, mean.timeboxed min.alltime,

    min.timeboxed sum.alltime, sum.timeboxed popular.timeboxed recent.limited

  8. QUERY DSL track 'popular-words', aggregator: popular.timeboxed field: (o) -> o.text.toLowerCase().split('

    ') period: 60 precision: 5 top: 10

  9. DEMO TIME!

  10. ESPER

  11. THE FUTURE...

  12. RIVER river = require('river') ctx = river.createContext() ctx.addQuery "SELECT SUM(foo)

    FROM my_stream", (newValues, oldValues) -> console.log(newValues, oldValues) c.push('my_stream', {foo:1, bar:2}) c.push('my_stream', {foo:3, bar:4}) https://github.com/forward/river

  13. SQL-PARSER https://github.com/forward/sql-parser

  14. PERSISTENCE

  15. THE END