Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
300
Regression
Avatar for Albert Bifet abifet
0
300
Evaluation
Avatar for Albert Bifet abifet
1
270
Stream Algorithmics
Avatar for Albert Bifet abifet
1
430
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
310
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
440

Other Decks in Research

See All in Research
【中間報告】国会議員の立法・政策実務を支える環境を巡る現状と課題
Avatar for 株式会社PoliPoli/PoliPoli.Inc polipoli
0
340
Vector Map as Language: Toward Unified Remote Sensing Vector Mapping
Avatar for SatAI.challenge satai
3
110
(SIGQS17) Frasco-VS：フラグメントに基づく薬剤候補化合物選抜の量子アニーリングによる実現
Avatar for Keisuke Yanagisawa keisukeyanagisawa
PRO
0
170
CVPR2026論文紹介_VLMにとって​良いvision encoderとは何か？​Rethinking Model Selection in VLM Through the Lens of Gromov-Wasserstein Distance​
Avatar for 小林優斗 kobayashi31
1
170
第12回人と環境にやさしい交通をめざす全国大会／熊本都市圏「車1割削減、渋滞半減、公共交通2倍」をめざして
Avatar for Traffic Brain trafficbrain
0
140
重要だけど測れていないもの：高齢者ケアの見えない課題
Avatar for テオリア・テクノロジーズ theoriatec2024
0
420
Using our influence and power for patient safety
Avatar for Helen Bevan helenbevan
0
370
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
320
衛星×エッジAI勉強会 衛星上におけるAI処理制約とそ取組について
Avatar for SatAI.challenge satai
4
620
2026年度 生成AI を活用した論文執筆ガイド／ワークショップ / 2026 Academic Year Guide to Writing Papers Using Generative AI - Workshop
Avatar for Kenji Saito ks91
PRO
0
190
LLM Compute Infrastructure Overview
Avatar for KARAKURI Inc. karakurist
2
1.5k
議論 学術ムーブメントを成功させるために何が必要なのだろうか
Avatar for Ryuichi Maruyama rmaruy
0
110

Featured

See All Featured
Sharpening the Axe: The Primacy of Toolmaking
Avatar for Bryan Cantrill bcantrill
46
2.9k
The Limits of Empathy - UXLibs8
Avatar for Cassini Nazir cassininazir
1
540
Have SEOs Ruined the Internet? - User Awareness of SEO in 2025
Avatar for Akash Hashmi akashhashmi
0
400
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
850
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
Tips & Tricks on How to Get Your First Job In Tech
Avatar for Honza Javorek honzajavorek
1
620
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
220
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
430
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3.4k
Claude Code のすすめ
Avatar for schroneko schroneko
67
230k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
1.9k
Joys of Absence: A Defence of Solitary Play
Avatar for Sebastian Deterding codingconduct
1
420

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology