Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
280
Regression
Avatar for Albert Bifet abifet
0
290
Evaluation
Avatar for Albert Bifet abifet
1
250
Stream Algorithmics
Avatar for Albert Bifet abifet
1
410
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
330
Ensemble Methods
Avatar for Albert Bifet abifet
0
300
Classification
Avatar for Albert Bifet abifet
0
360
Concept Drift
Avatar for Albert Bifet abifet
0
430

Other Decks in Research

See All in Research
R&Dチームを起ち上げる
Avatar for shibuiwilliam shibuiwilliam
1
200
教師あり学習と強化学習で作る 最強の数学特化LLM
Avatar for Hiroshi Y (RabotniKuma) analokmaus
2
980
討議：RACDA設立30周年記念都市交通フォーラム2026
Avatar for Traffic Brain trafficbrain
0
640
一般道の交通量減少と速度低下についての全国分析と熊本市におけるケーススタディ（20251122 土木計画学研究発表会）
Avatar for Traffic Brain trafficbrain
0
180
LLM-Assisted Semantic Guidance for Sparsely Annotated Remote Sensing Object Detection
Avatar for SatAI.challenge satai
3
630
[IBIS 2025] 深層基盤モデルのための強化学習 驚きから理論にもとづく納得へ
Avatar for Akifumi Wachi akifumi_wachi
20
9.8k
「車1割削減、渋滞半減、公共交通2倍」を 熊本から岡山へ＠RACDA設立30周年記念都市交通フォーラム2026
Avatar for Traffic Brain trafficbrain
1
800
IEEE AIxVR 2026 Keynote Talk: "Beyond Visibility: Understanding Scenes and Humans under Challenging Conditions with Diverse Sensing"
Avatar for Mariko Isogawa miso2024
0
130
第二言語習得研究における 明示的・暗示的知識の再検討：この分類は何に役に立つか，何に役に立たないか
Avatar for Yu Tamura tam07pb915
0
2.1k
Thirty Years of Progress in Speech Synthesis: A Personal Perspective on the Past, Present, and Future
Avatar for Keiichi Tokuda ktokuda
0
190
病院向け生成AIプロダクト開発の実践と課題
Avatar for Takashi Nishibayashi hagino3000
0
580
An Open and Reproducible Deep Research Agent for Long-Form Question Answering
Avatar for Ikuya Yamada ikuyamada
0
350

Featured

See All Featured
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
9.9k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
10
1.1k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
174
15k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
320
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
88
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
Avatar for Aleyda Solis aleyda
1
1.9k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
Avatar for Sara Fernández Carmona sarafernandez
0
150
The AI Search Optimization Roadmap by Aleyda Solis
Avatar for Aleyda Solis aleyda
1
5.5k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
2
570
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
820

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology