Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
240
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
220
Stream Algorithmics
Avatar for Albert Bifet abifet
1
370
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
290
Ensemble Methods
Avatar for Albert Bifet abifet
0
250
Classification
Avatar for Albert Bifet abifet
0
330
Concept Drift
Avatar for Albert Bifet abifet
0
380

Other Decks in Research

See All in Research
NLP2025SharedTask翻訳部門
Avatar for MORIOKA Taku moriokataku
0
290
Google Agent Development Kit (ADK) 入門 🚀
Avatar for MIKIO KUBO mickey_kubo
2
720
言語モデルによるAI創薬の進展 / Advancements in AI-Driven Drug Discovery Using Language Models
Avatar for tsurubee tsurubee
2
360
Pix2Poly: A Sequence Prediction Method for End-to-end Polygonal Building Footprint Extraction from Remote Sensing Imagery
Avatar for SatAI.challenge satai
3
400
VAGeo: View-specific Attention for Cross-View Object Geo-Localization
Avatar for SatAI.challenge satai
3
310
利用シーンを意識した推薦システム 〜SpotifyとAmazonの事例から〜
Avatar for kuri8ive kuri8ive
1
200
AIによる画像認識技術の進化 -25年の技術変遷を振り返る-
Avatar for Hironobu Fujiyoshi hf149
6
3.1k
言語モデルの内部機序：解析と解釈
Avatar for Sho Yokoi eumesy
PRO
43
17k
EarthMarker: A Visual Prompting Multimodal Large Language Model for Remote Sensing
Avatar for SatAI.challenge satai
3
270
さくらインターネット研究所 アップデート2025年
Avatar for MATSUMOTO Ryosuke matsumoto_r
PRO
0
610
Self-supervised audiovisual representation learning for remote sensing data
Avatar for SatAI.challenge satai
3
200
自然由来エネルギーの揺らぎによるワークロード移動を想定した超個体データセンターシステムの検討進捗状況
Avatar for KIKUCHI Shunsuke kikuzo
0
130

Featured

See All Featured
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
42
7.5k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
10
620
BBQ
Avatar for Matthew Crist matthewcrist
89
9.7k
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
667
120k
Visualization
Avatar for Eitan Lees eitanlees
146
16k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
271
27k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
26k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
28
5.4k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
188
11k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
30
980
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
337
57k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology