Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
280
Regression
Avatar for Albert Bifet abifet
0
290
Evaluation
Avatar for Albert Bifet abifet
1
240
Stream Algorithmics
Avatar for Albert Bifet abifet
1
410
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
320
Ensemble Methods
Avatar for Albert Bifet abifet
0
300
Classification
Avatar for Albert Bifet abifet
0
350
Concept Drift
Avatar for Albert Bifet abifet
0
420

Other Decks in Research

See All in Research
[Devfest Incheon 2025] 모두를 위한 친절한 언어모델(LLM) 학습 가이드
Avatar for Beomi beomi
2
1.4k
Remote sensing × Multi-modal meta survey
Avatar for SatAI.challenge satai
4
710
さまざまなAgent FrameworkとAIエージェントの評価
Avatar for Kento.Yamada ymd65536
1
410
Can AI Generated Ambrotype Chain the Aura of Alternative Process? In SIGGRAPH Asia 2024 Art Papers
Avatar for Chinatsu Ozawa toremolo72
0
130
大規模言語モデルにおけるData-Centric AIと合成データの活用 / Data-Centric AI and Synthetic Data in Large Language Models
Avatar for tsurubee tsurubee
1
490
音声感情認識技術の進展と展望
Avatar for Ryotaro Nagase nagase
0
460
Thirty Years of Progress in Speech Synthesis: A Personal Perspective on the Past, Present, and Future
Avatar for Keiichi Tokuda ktokuda
0
160
HoliTracer:Holistic Vectorization of Geographic Objects from Large-Size Remote Sensing Imagery
Avatar for SatAI.challenge satai
3
610
存立危機事態の再検討
Avatar for Ken Jimbo jimboken
0
240
LiDARセキュリティ最前線（2025年）
Avatar for Yoshioka Lab (Keio CSG) kentaroy47
0
120
ロボット学習における大規模検索技術の展開と応用
Avatar for Mai Nishimura denkiwakame
1
210
Akamaiのキャッシュ効率を支えるAdaptSizeについての論文を読んでみた
Avatar for bootjp / ぶーと bootjp
1
440

Featured

See All Featured
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
0
140
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
141
7.3k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
247
13k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
174
15k
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
74
11k
Fireside Chat
Avatar for paigeccino paigeccino
41
3.8k
From Legacy to Launchpad: Building Startup-Ready Communities
Avatar for Dug Song dugsong
0
140
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
120
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
52
5.8k
What the history of the web can teach us about the future of AI
Avatar for Ines Montani inesmontani
PRO
1
430
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
170

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology