Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
280
Regression
Avatar for Albert Bifet abifet
0
290
Evaluation
Avatar for Albert Bifet abifet
1
250
Stream Algorithmics
Avatar for Albert Bifet abifet
1
410
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
330
Ensemble Methods
Avatar for Albert Bifet abifet
0
300
Classification
Avatar for Albert Bifet abifet
0
360
Concept Drift
Avatar for Albert Bifet abifet
0
430

Other Decks in Research

See All in Research
SREのためのテレメトリー技術の探究 / Telemetry for SRE
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
13
3.2k
[チュートリアル] 電波マップ構築入門 ：研究動向と課題設定の勘所
Avatar for Koya SATO k_sato
0
300
湯村研究室の紹介2025 / yumulab2025
Avatar for yumulab yumulab
0
310
ブレグマン距離最小化に基づくリース表現量推定： バイアス除去学習の統一理論
Avatar for MasaKat0 masakat0
0
170
音声感情認識技術の進展と展望
Avatar for Ryotaro Nagase nagase
0
500
財務諸表監査のための逐次検定
Avatar for MasaKat0 masakat0
1
270
LiDARセキュリティ最前線（2025年）
Avatar for Yoshioka Lab (Keio CSG) kentaroy47
0
210
衛星×エッジAI勉強会 衛星上におけるAI処理制約とそ取組について
Avatar for SatAI.challenge satai
3
240
Akamaiのキャッシュ効率を支えるAdaptSizeについての論文を読んでみた
Avatar for bootjp / ぶーと bootjp
1
480
空間音響処理における物理法則に基づく機械学習
Avatar for NII S. Koyama's Lab skoyamalab
0
230
Ankylosing Spondylitis
Avatar for Charles Holtzkampf ankh2054
0
140
第66回コンピュータビジョン勉強会＠関東 Epona: Autoregressive Diffusion World Model for Autonomous Driving
Avatar for Kento Sasaki kentosasaki
0
440

Featured

See All Featured
Between Models and Reality
Avatar for mayunak mayunak
2
220
Amusing Abliteration
Avatar for ianozsvald ianozsvald
0
120
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
140
Building a A Zero-Code AI SEO Workflow
Avatar for Ian Lurie portentint
PRO
0
370
Building Applications with DynamoDB
Avatar for Matt Wood mza
96
6.9k
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
Avatar for Greg Gifford greggifford
PRO
0
93
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
128
17k
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
How to build an LLM SEO readiness audit: a practical framework
Avatar for Nick Samuel nmsamuel
1
660
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
Avatar for Yuki Nakata chikuwait chikuwait
0
380
Chasing Engaging Ingredients in Design
Avatar for Sebastian Deterding codingconduct
0
130
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
130

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology