Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
310
Regression
Avatar for Albert Bifet abifet
0
310
Evaluation
Avatar for Albert Bifet abifet
1
280
Stream Algorithmics
Avatar for Albert Bifet abifet
1
440
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
320
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
450

Other Decks in Research

See All in Research
コーディングエージェントとABNを再考
Avatar for Hironobu Fujiyoshi hf149
2
850
研究室単位での自律的 IPv6接続性確立に向けたAS共同運用モデルの提案と実証
Avatar for Hiroki (REO) Kashiwazaki reokashiwa
PRO
0
210
LINEヤフー データサイエンス Meetup「三井物産コモディティ予測チャレンジ」の舞台裏-AlpacaTechパート
Avatar for tomo gamella
1
650
最先端NLP 2026 論文紹介: Wait, Wait, Wait... Why Do Reasoning Models Loop? / SNLP Paper Review: Wait, Wait, Wait... Why Do Reasoning Models Loop?
Avatar for tkng tkng
0
200
論文紹介: Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mind
Avatar for Hisao Katsumi hisaokatsumi
0
150
Using our influence and power for patient safety
Avatar for Helen Bevan helenbevan
0
410
クラウド・AI 時代の研究開発 DX / R&D Digital Transformation
Avatar for Yoshitaka Haribara hariby
0
120
National high-resolution cropland classification of Japan with agricultural census information and multi-temporal multi-modality datasets
Avatar for SatAI.challenge satai
3
480
東京大学工学部計数工学科、計数工学特別講義の説明資料
Avatar for KIKUCHI Shunsuke kikuzo
0
640
EIRによる不正端末のブロッキング 5G時代におけるデバイス識別と不正対策の進化
Avatar for Stellar Craft, Inc. stellarcraft
0
130
MIRU2026 チュートリアル講演2：三次元データ処理の動向
Avatar for Naoya Chiba nnchiba
6
4.7k
大規模言語モデルは誰を覚えているか / Who Do Large Language Models Memorize?
Avatar for Shotaro Ishihara upura
0
150

Featured

See All Featured
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
360
30k
技術選定の審美眼（2025年版） / Understanding the Spiral of Technologies 2025 edition
Avatar for Takuto WADA twada
PRO
120
120k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.8k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
7k
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
460
AI: The stuff that nobody shows you
Avatar for John Nunemaker jnunemaker
PRO
9
960
The B2B funnel & how to create a winning content strategy
Avatar for Katarina Dahlin katarinadahlin
PRO
1
490
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
281
24k
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
57
14k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
31
6.2k
Sam Torres - BigQuery for SEOs
Avatar for Tech SEO Connect techseoconnect
PRO
0
510

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology