Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
280
Regression
Avatar for Albert Bifet abifet
0
290
Evaluation
Avatar for Albert Bifet abifet
1
240
Stream Algorithmics
Avatar for Albert Bifet abifet
1
410
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
320
Ensemble Methods
Avatar for Albert Bifet abifet
0
300
Classification
Avatar for Albert Bifet abifet
0
350
Concept Drift
Avatar for Albert Bifet abifet
0
420

Other Decks in Research

See All in Research
地域丸ごとデイサービス「Go トレ」の紹介
Avatar for SMARTふくしラボ smartfukushilab1
0
890
Agentic AI フレームワーク戦略白書 (2025年度版）
Avatar for MIKIO KUBO mickey_kubo
1
120
一般道の交通量減少と速度低下についての全国分析と熊本市におけるケーススタディ（20251122 土木計画学研究発表会）
Avatar for Traffic Brain trafficbrain
0
150
ペットのかわいい瞬間を撮影する オートシャッターAIアプリへの スマートラベリングの適用
Avatar for Convergence Lab. mssmkmr
0
230
Pythonでジオを使い倒そう！ 〜それとFOSS4G Hiroshima 2026のご紹介を少し〜
Avatar for wata909 wata909
0
1.3k
Proposal of an Information Delivery Method for Electronic Paper Signage Using Human Mobility as the Communication Medium / ICCE-Asia 2025
Avatar for yumulab yumulab
0
160
Tiaccoon: Unified Access Control with Multiple Transports in Container Networks
Avatar for Hiroya Onoe hiroyaonoe
0
570
社内データ分析AIエージェントを できるだけ使いやすくする工夫
Avatar for Yusuke Fukasawa fufufukakaka
1
880
20251023_くまもと21の会例会_「車1割削減、渋滞半減、公共交通2倍」をめざして.pdf
Avatar for Traffic Brain trafficbrain
0
180
2025-11-21-DA-10th-satellite
Avatar for Yuka Egusa yegusa
0
110
製造業主導型経済からサービス経済化における中間層形成メカニズムのパラダイムシフト
Avatar for Masatake Yamoto yamotty
0
480
超高速データサイエンス
Avatar for Yusuke Matsui matsui_528
2
380

Featured

See All Featured
Building the Perfect Custom Keyboard
Avatar for Naoto Takai takai
2
680
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
160
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
Avatar for Aleyda Solis aleyda
1
1.9k
Typedesign – Prime Four
Avatar for Hannes Fritz hannesfritz
42
2.9k
brightonSEO & MeasureFest 2025 - Christian Goodrich - Winning strategies for Black Friday CRO & PPC
Avatar for Christian Goodrich cargoodrich
3
97
ラッコキーワード サービス紹介資料
Avatar for ラッコ株式会社 rakko
1
2.2M
State of Search Keynote: SEO is Dead Long Live SEO
Avatar for Ryan Jones ryanjones
0
110
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.2k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
302
51k
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
Avatar for Katarina Dahlin katarinadahlin
PRO
0
3.4k
Agile Leadership in an Agile Organization
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
79
Prompt Engineering for Job Search
Avatar for Mfonobong Umondia mfonobong
0
160

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology