Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
280
Regression
Avatar for Albert Bifet abifet
0
290
Evaluation
Avatar for Albert Bifet abifet
1
240
Stream Algorithmics
Avatar for Albert Bifet abifet
1
410
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
320
Ensemble Methods
Avatar for Albert Bifet abifet
0
300
Classification
Avatar for Albert Bifet abifet
0
350
Concept Drift
Avatar for Albert Bifet abifet
0
420

Other Decks in Research

See All in Research
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
Avatar for Yuki Nakata chikuwait chikuwait
0
320
【SIGGRAPH Asia 2025】Lo-Fi Photograph with Lo-Fi Communication
Avatar for Chinatsu Ozawa toremolo72
0
110
自動運転におけるデータ駆動型AIに対する安全性の考え方 / Safety Engineering for Data-Driven AI in Autonomous Driving Systems
Avatar for Fuyuki Ishikawa / 石川 冬樹 ishikawafyu
0
130
20年前に50代だった人たちの今
Avatar for marimari hysmrk
0
140
Community Driveプロジェクト（CDPJ）の中間報告
Avatar for SMARTふくしラボ smartfukushilab1
0
160
超高速データサイエンス
Avatar for Yusuke Matsui matsui_528
2
380
音声感情認識技術の進展と展望
Avatar for Ryotaro Nagase nagase
0
460
ローテーション別のサイドアウト戦略 ~なぜあのローテは回らないのか？~
Avatar for ぱんだ vball_panda
0
280
ブレグマン距離最小化に基づくリース表現量推定： バイアス除去学習の統一理論
Avatar for MasaKat0 masakat0
0
130
製造業主導型経済からサービス経済化における中間層形成メカニズムのパラダイムシフト
Avatar for Masatake Yamoto yamotty
0
480
20251023_くまもと21の会例会_「車1割削減、渋滞半減、公共交通2倍」をめざして.pdf
Avatar for Traffic Brain trafficbrain
0
180
存立危機事態の再検討
Avatar for Ken Jimbo jimboken
0
240

Featured

See All Featured
Tips & Tricks on How to Get Your First Job In Tech
Avatar for Honza Javorek honzajavorek
0
430
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
0
230
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
356
21k
We Analyzed 250 Million AI Search Results: Here's What I Found
Avatar for Josh Blyskal joshbly
1
690
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
2
410
Sam Torres - BigQuery for SEOs
Avatar for Tech SEO Connect techseoconnect
PRO
0
180
Code Reviewing Like a Champion
Avatar for maltzj maltzj
527
40k
How GitHub (no longer) Works
Avatar for Zach Holman holman
316
140k
Deep Space Network (abreviated)
Avatar for Tony Rice tonyrice
0
47
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
Avatar for Aleyda Solis aleyda
0
1.9k
How to audit for AI Accessibility on your Front & Back End
Avatar for davetheseo davetheseo
0
180
Fireside Chat
Avatar for paigeccino paigeccino
41
3.8k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology