Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
270
Regression
Avatar for Albert Bifet abifet
0
280
Evaluation
Avatar for Albert Bifet abifet
1
240
Stream Algorithmics
Avatar for Albert Bifet abifet
1
400
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
320
Ensemble Methods
Avatar for Albert Bifet abifet
0
290
Classification
Avatar for Albert Bifet abifet
0
350
Concept Drift
Avatar for Albert Bifet abifet
0
420

Other Decks in Research

See All in Research
教師あり学習と強化学習で作る 最強の数学特化LLM
Avatar for Hiroshi Y (RabotniKuma) analokmaus
2
820
データサイエンティストの業務変化
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
120
第二言語習得研究における 明示的・暗示的知識の再検討：この分類は何に役に立つか，何に役に立たないか
Avatar for Yu Tamura tam07pb915
0
690
Language Models Are Implicitly Continuous
Avatar for Sho Yokoi eumesy
PRO
0
370
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.1k
超高速データサイエンス
Avatar for Yusuke Matsui matsui_528
1
340
ドメイン知識がない領域での自然言語処理の始め方
Avatar for Hayahide Yamagishi hargon24
1
230
J-RAGBench: 日本語RAGにおける Generator評価ベンチマークの構築
Avatar for Koki Itai koki_itai
0
1.1k
自動運転におけるデータ駆動型AIに対する安全性の考え方 / Safety Engineering for Data-Driven AI in Autonomous Driving Systems
Avatar for Fuyuki Ishikawa / 石川 冬樹 ishikawafyu
0
110
GPUを利用したStein Particle Filterによる点群6自由度モンテカルロSLAM
Avatar for TakumiNakao takuminakao
0
780
Pythonでジオを使い倒そう！ 〜それとFOSS4G Hiroshima 2026のご紹介を少し〜
Avatar for wata909 wata909
0
1.2k
AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label data
Avatar for SatAI.challenge satai
3
670

Featured

See All Featured
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
120
Chasing Engaging Ingredients in Design
Avatar for Sebastian Deterding codingconduct
0
93
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
State of Search Keynote: SEO is Dead Long Live SEO
Avatar for Ryan Jones ryanjones
0
80
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
190
Un-Boring Meetings
Avatar for Sebastian Deterding codingconduct
0
170
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
62k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
39
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.5k
It's Worth the Effort
Avatar for 3n 3n
187
29k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
31
5.8k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology