Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
300
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
290
Regression
Avatar for Albert Bifet abifet
0
300
Evaluation
Avatar for Albert Bifet abifet
1
270
Stream Algorithmics
Avatar for Albert Bifet abifet
1
430
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
310
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
440

Other Decks in Research

See All in Research
[BlackHatAsia2026] Hidden Telemetry: Uncovering TraceLogging ETW Providers You're Not Using (Yet)
Avatar for Asuka Nakajima asuna_jp
1
530
Apache Gravitinoで実現する Icebergカタログ統合とアクセスの一元化
Avatar for matsumooon matsumooon
0
290
2026 東京科学大 情報通信系 研究室紹介 (大岡山)
Avatar for Tokyo Tech ICT Dept. icttitech
0
3.8k
敵対生成プロンプト同時探索による内省型プロンプト最適化
Avatar for Kotaro Inoue kinoue_smarthr
0
210
Data Visualization Tools in the Age of AI
Avatar for Fritz Lekschas flekschas
0
160
The Landscape of Agentic Reinforcement Learning for LLMs: A Survey
Avatar for Shunsuke KITADA shunk031
4
1k
RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent
Avatar for SatAI.challenge satai
2
300
2026年3月1日（日）福島「除染土」の公共利用をかんがえる
Avatar for Masano Atsuko atsukomasano2026
0
640
AI Agentの精度改善に見るML開発との共通点 / commonalities in accuracy improvements in agentic era
Avatar for shimacos shimacos
6
1.7k
Φ-Sat-2のAutoEncoderによる情報圧縮系論文
Avatar for SatAI.challenge satai
4
780
AIで最適化を解けるか？
Avatar for MIKIO KUBO mickey_kubo
0
120
National high-resolution cropland classification of Japan with agricultural census information and multi-temporal multi-modality datasets
Avatar for SatAI.challenge satai
3
290

Featured

See All Featured
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
63k
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
360
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
410
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
230k
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
1.8k
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
4.1k
Money Talks: Using Revenue to Get Sh*t Done
Avatar for Nikki Halliwell nikkihalliwell
0
250
Accessibility Awareness
Avatar for Sarah Abderemane sabderemane
1
140
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
Avatar for Aleyda Solis aleyda
1
2.1k
The Director’s Chair: Orchestrating AI for Truly Effective Learning
Avatar for Mike Taylor tmiket
1
190
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
240

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology