Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
280
Regression
Avatar for Albert Bifet abifet
0
290
Evaluation
Avatar for Albert Bifet abifet
1
250
Stream Algorithmics
Avatar for Albert Bifet abifet
1
410
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
330
Ensemble Methods
Avatar for Albert Bifet abifet
0
300
Classification
Avatar for Albert Bifet abifet
0
360
Concept Drift
Avatar for Albert Bifet abifet
0
430

Other Decks in Research

See All in Research
[SITA2025 Workshop] 空中計算による高速・低遅延な分散回帰分析
Avatar for Koya SATO k_sato
0
120
姫路市 -都市OSの「再実装」-
Avatar for Hopin hopin
0
1.7k
A History of Approximate Nearest Neighbor Search from an Applications Perspective
Avatar for Yusuke Matsui matsui_528
1
190
一般道の交通量減少と速度低下についての全国分析と熊本市におけるケーススタディ（20251122 土木計画学研究発表会）
Avatar for Traffic Brain trafficbrain
0
180
ローテーション別のサイドアウト戦略 ~なぜあのローテは回らないのか？~
Avatar for ぱんだ vball_panda
0
300
「なんとなく」の顧客理解から脱却する ──顧客の解像度を武器にするインサイトマネジメント
Avatar for 田島佳穂 tajima_kaho
10
6.8k
ペットのかわいい瞬間を撮影する オートシャッターAIアプリへの スマートラベリングの適用
Avatar for Convergence Lab. mssmkmr
0
370
Akamaiのキャッシュ効率を支えるAdaptSizeについての論文を読んでみた
Avatar for bootjp / ぶーと bootjp
1
490
病院向け生成AIプロダクト開発の実践と課題
Avatar for Takashi Nishibayashi hagino3000
0
570
その推薦システムの評価指標、ユーザーの感覚とズレてるかも
Avatar for kuri8ive kuri8ive
1
340
離散凸解析に基づく予測付き離散最適化手法 (IBIS '25)
Avatar for Taihei OKI taihei_oki
PRO
1
720
「車1割削減、渋滞半減、公共交通2倍」を 熊本から岡山へ＠RACDA設立30周年記念都市交通フォーラム2026
Avatar for Traffic Brain trafficbrain
1
720

Featured

See All Featured
Un-Boring Meetings
Avatar for Sebastian Deterding codingconduct
0
220
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
9.8k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.8k
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
630
Visualization
Avatar for Eitan Lees eitanlees
150
17k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
82
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
130
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
333
24k
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
1
2k
<Decoding/> the Language of Devs - We Love SEO 2024
Avatar for Nikki Halliwell nikkihalliwell
1
150
Measuring Dark Social's Impact On Conversion and Attribution
Avatar for Stephen Akadiri stephenakadiri
1
150

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology