Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
250
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
230
Stream Algorithmics
Avatar for Albert Bifet abifet
1
380
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
300
Ensemble Methods
Avatar for Albert Bifet abifet
0
250
Classification
Avatar for Albert Bifet abifet
0
330
Concept Drift
Avatar for Albert Bifet abifet
0
400

Other Decks in Research

See All in Research
SSII2025 [TS2] リモートセンシング画像処理の最前線
Avatar for 画像センシングシンポジウム ssii
PRO
7
3.1k
データｘデジタルマップで拓く
ミラノ発・地域共創最前線
Avatar for mapconcierge mapconcierge4agu
0
210
日本語新聞記事を用いた大規模言語モデルの暗記定量化 / LLMC2025
Avatar for Shotaro Ishihara upura
0
180
GPUを利用したStein Particle Filterによる点群6自由度モンテカルロSLAM
Avatar for TakumiNakao takuminakao
0
250
2021年度-基盤研究B-研究計画調書
Avatar for Y. Yamamoto trycycle
PRO
0
290
Creation and environmental applications of 15-year daily inundation and vegetation maps for Siberia by integrating satellite and meteorological datasets
Avatar for SatAI.challenge satai
3
260
ストレス計測方法の確立に向けたマルチモーダルデータの活用
Avatar for Yuriko Kikuchi yurikomium
0
1.4k
数理最適化に基づく制御
Avatar for MIKIO KUBO mickey_kubo
6
730
一人称視点映像解析の最先端（MIRU2025 チュートリアル）
Avatar for Takuma Yagi takumayagi
6
3.4k
SSII2025 [SS1] レンズレスカメラ
Avatar for 画像センシングシンポジウム ssii
PRO
2
1.1k
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
240
NLP Colloquium
Avatar for Juno Kim junokim
1
200

Featured

See All Featured
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
59
9.5k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
A better future with KSS
Avatar for Kyle Neath kneath
239
17k
Done Done
Avatar for chrislema chrislema
185
16k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
1
20
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
54
11k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
53k
Designing for Performance
Avatar for Lara Hogan lara
610
69k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
190
11k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
330
21k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
272
27k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology