Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
280

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
260
Regression
Avatar for Albert Bifet abifet
0
270
Evaluation
Avatar for Albert Bifet abifet
1
230
Stream Algorithmics
Avatar for Albert Bifet abifet
1
390
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
310
Ensemble Methods
Avatar for Albert Bifet abifet
0
260
Classification
Avatar for Albert Bifet abifet
0
340
Concept Drift
Avatar for Albert Bifet abifet
0
410

Other Decks in Research

See All in Research
ip71_contraflow_reconfiguration
Avatar for SatokiMasuda stkmsd
0
110
Adaptive Experimental Design for Efficient Average Treatment Effect Estimation and Treatment Choice
Avatar for MasaKat0 masakat0
0
130
Pythonでジオを使い倒そう！ 〜それとFOSS4G Hiroshima 2026のご紹介を少し〜
Avatar for wata909 wata909
0
1.1k
RHO-1: Not All Tokens Are What You Need
Avatar for Sansan R&D sansan_randd
1
200
【輪講資料】Moshi: a speech-text foundation model
for real-time dialogue
Avatar for Hayato Tsukagoshi hpprc
3
770
MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
Avatar for SatAI.challenge satai
4
380
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
63
33k
CVPR2025論文紹介：Unboxed
Avatar for 村川卓也 murakawatakuya
0
180
2025/7/5 応用音響研究会招待講演＠北海道大学
Avatar for Takuma OKAMOTO takuma_okamoto
1
230
言語モデルの地図：確率分布と 情報幾何による類似性の可視化
Avatar for Hidetoshi Shimodaira shimosan
8
2k
Time to Cash: The Full Stack Breakdown of Modern ATM Attacks
Avatar for D ratatata
0
160
不確実性下における目的と手段の統合的探索に向けた連続腕バンディットの応用 / iot70_gp_rff_mab
Avatar for monochromegane monochromegane
2
210

Featured

See All Featured
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
36
6.1k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
57k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
11k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
302
51k
Sharpening the Axe: The Primacy of Toolmaking
Avatar for Bryan Cantrill bcantrill
46
2.5k
The Language of Interfaces
Avatar for Des Traynor destraynor
162
25k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
38
2.9k
Leading Effective Engineering Teams in the AI Era
Avatar for Addy Osmani addyosmani
8
980
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
225
10k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
9
960

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology