Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Distributed Systems

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
310
Regression
Avatar for Albert Bifet abifet
0
310
Evaluation
Avatar for Albert Bifet abifet
1
280
Stream Algorithmics
Avatar for Albert Bifet abifet
1
440
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
280
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
320
Classification
Avatar for Albert Bifet abifet
0
390
Concept Drift
Avatar for Albert Bifet abifet
0
460

Other Decks in Research

See All in Research
XDPerf: A High-Performance Traffic Generator Built with WASM and eBPF
Avatar for Takeru Hayasaka takehaya
1
340
Prithvi-EO-2.0
Avatar for SatAI.challenge satai
3
100
敵対生成プロンプト同時探索による内省型プロンプト最適化
Avatar for Kotaro Inoue kinoue_smarthr
0
440
ros2-perf-multihost: Automated Coordination Framework for Objective Architecture Evaluation in Distributed Systems
Avatar for takasehideki takasehideki
0
150
[最先端NLP勉強会2026] Agentic Rubrics as Contextual Verifiers for SWE Agents
Avatar for Ryo Fujii rfujii
1
390
Visual SLAM未来予測 / Future Prediction in Visual SLAM
Avatar for koide3 koide3
1
1.3k
ハードウェア研究で国際トップ会議を目指す！IROS 2027での論文採択を目指して
Avatar for 金田礼人 ayatokanada
7
4.1k
研究室単位での自律的 IPv6接続性確立に向けたAS共同運用モデルの提案と実証
Avatar for Hiroki (REO) Kashiwazaki reokashiwa
PRO
0
230
長時間動画QAにおけるマルチエージェント推論 ・SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration
Avatar for 村川卓也 murakawatakuya
1
230
Karkada さんの論文 × 2 の紹介: (1) Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models, (2) Symmetry in language statistics shapes the geometry of model representations
Avatar for Sho Yokoi eumesy
PRO
1
860
データサイエンティストの就労意識～2015 → 2026 一般(個人)会員アンケートより
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
1k
【ローカルAIに向き合う展示会vol.2】液体時間定数型モジュールを用いた オリジナルの双方向エンコーダーモデルNexteraBERT 推論速度向上検討並びにダウンストリーム評価
Avatar for Rikka Botan rikkabotan7
0
230

Featured

See All Featured
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
1
580
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
500
What the history of the web can teach us about the future of AI
Avatar for Ines Montani inesmontani
PRO
2
740
Code Reviewing Like a Champion
Avatar for maltzj maltzj
529
40k
The Power of CSS Pseudo Elements
Avatar for Geoffrey Crofte geoffreycrofte
82
6.6k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
370
20k
技術選定の審美眼（2025年版） / Understanding the Spiral of Technologies 2025 edition
Avatar for Takuto WADA twada
PRO
120
120k
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
20k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
52k
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
Avatar for Yuki Nakata chikuwait chikuwait
0
890
Pawsitive SEO: Lessons from My Dog (and Many Mistakes) on Thriving as a Consultant in the Age of AI
Avatar for David Carrasco davidcarrasco
0
260
WCS-LA-2024
Avatar for Leonardo Collado-Torres lcolladotor
0
890

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology