Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
250
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
230
Stream Algorithmics
Avatar for Albert Bifet abifet
1
380
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
300
Ensemble Methods
Avatar for Albert Bifet abifet
0
250
Classification
Avatar for Albert Bifet abifet
0
330
Concept Drift
Avatar for Albert Bifet abifet
0
400

Other Decks in Research

See All in Research
snlp2025_prevent_llm_spikes
Avatar for Sho Takase takase
0
160
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
0
150
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
240
Learning to (Learn at Test Time): RNNs with Expressive Hidden States
Avatar for Hiroto Kurita kurita
0
170
2025年度人工知能学会全国大会チュートリアル講演「深層基盤モデルの数理」
Avatar for Taiji Suzuki taiji_suzuki
25
18k
数理最適化と機械学習の融合
Avatar for MIKIO KUBO mickey_kubo
16
9.3k
Adaptive Experimental Design for Efficient Average Treatment Effect Estimation and Treatment Choice
Avatar for MasaKat0 masakat0
0
160
Combinatorial Search with Generators
Avatar for Keisuke Okumura | 奥村圭祐 kei18
0
740
VectorLLM: Human-like Extraction of Structured Building Contours via Multimodal LLMs
Avatar for SatAI.challenge satai
4
190
SNLP2025:Can Language Models Reason about Individualistic Human Values and Preferences?
Avatar for Yuki Zenimoto yukizenimoto
0
120
[論文紹介] Intuitive Fine-Tuning
Avatar for Ryokan RI ryou0634
0
110
Creation and environmental applications of 15-year daily inundation and vegetation maps for Siberia by integrating satellite and meteorological datasets
Avatar for SatAI.challenge satai
3
260

Featured

See All Featured
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
45
7.6k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
46
7.6k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
187
55k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.5k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
268
13k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
160
23k
A better future with KSS
Avatar for Kyle Neath kneath
239
17k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
207
24k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
126
17k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
53k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
33
2.4k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
332
24k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology