Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
280
Regression
Avatar for Albert Bifet abifet
0
280
Evaluation
Avatar for Albert Bifet abifet
1
240
Stream Algorithmics
Avatar for Albert Bifet abifet
1
410
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
320
Ensemble Methods
Avatar for Albert Bifet abifet
0
300
Classification
Avatar for Albert Bifet abifet
0
350
Concept Drift
Avatar for Albert Bifet abifet
0
420

Other Decks in Research

See All in Research
Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning
Avatar for SatAI.challenge satai
3
460
視覚から身体性を持つAIへ: 巧緻な動作の3次元理解
Avatar for Take Ohkawa tkhkaeio
0
180
LLM-Assisted Semantic Guidance for Sparsely Annotated Remote Sensing Object Detection
Avatar for SatAI.challenge satai
3
440
When Learned Data Structures Meet Computer Vision
Avatar for Yusuke Matsui matsui_528
1
2.6k
20251023_くまもと21の会例会_「車1割削減、渋滞半減、公共交通2倍」をめざして.pdf
Avatar for Traffic Brain trafficbrain
0
170
ACL読み会2025: Can Language Models Reason about Individualistic Human Values and Preferences?
Avatar for Yuki Zenimoto yukizenimoto
0
120
[Devfest Incheon 2025] 모두를 위한 친절한 언어모델(LLM) 학습 가이드
Avatar for Beomi beomi
2
1.4k
財務諸表監査のための逐次検定
Avatar for MasaKat0 masakat0
1
250
教師あり学習と強化学習で作る 最強の数学特化LLM
Avatar for Hiroshi Y (RabotniKuma) analokmaus
2
880
生成AI による論文執筆サポート・ワークショップ 論文執筆・推敲編 / Generative AI-Assisted Paper Writing Support Workshop: Drafting and Revision Edition
Avatar for Kenji Saito ks91
PRO
0
120
SREはサイバネティクスの夢をみるか？ / Do SREs Dream of Cybernetics?
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
3
360
2025-11-21-DA-10th-satellite
Avatar for Yuka Egusa yegusa
0
110

Featured

See All Featured
AI Search:
Where Are We & What Can We Do About It?
Avatar for Aleyda Solis aleyda
0
6.9k
How to Grow Your eCommerce with AI & Automation
Avatar for Katarina Dahlin katarinadahlin
PRO
0
100
技術選定の審美眼（2025年版） / Understanding the Spiral of Technologies 2025 edition
Avatar for Takuto Wada twada
PRO
117
100k
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
Avatar for Aleyda Solis aleyda
2
9.5k
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
0
130
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
74
5k
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
Avatar for Sara Fernández Carmona sarafernandez
1
1.3k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
120
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
Avatar for r-kagaya rkaga
59
42k
A Guide to Academic Writing Using Generative AI - A Workshop
Avatar for Kenji Saito ks91
PRO
0
190
Navigating the Design Leadership Dip - Product Design Week Design Leaders+ Conference 2024
Avatar for Andy Polaine apolaine
0
170
Public Speaking Without Barfing On Your Shoes - THAT 2023
Avatar for David Neal reverentgeek
1
300

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology