Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
290
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
290
Regression
Avatar for Albert Bifet abifet
0
290
Evaluation
Avatar for Albert Bifet abifet
1
250
Stream Algorithmics
Avatar for Albert Bifet abifet
1
410
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
330
Ensemble Methods
Avatar for Albert Bifet abifet
0
300
Classification
Avatar for Albert Bifet abifet
0
360
Concept Drift
Avatar for Albert Bifet abifet
0
430

Other Decks in Research

See All in Research
ローテーション別のサイドアウト戦略 ~なぜあのローテは回らないのか？~
Avatar for ぱんだ vball_panda
0
310
AIスーパーコンピュータにおけるLLM学習処理性能の計測と可観測性 / AI Supercomputer LLM Benchmarking and Observability
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
1
800
羽田新ルート運用6年の検証
Avatar for マン点 1manken
0
110
LOSの検討（λ Kansai 2026 in Winter）
Avatar for Motohiro Yakura motopu
0
110
生成AI による論文執筆サポート・ワークショップ 論文執筆・推敲編 / Generative AI-Assisted Paper Writing Support Workshop: Drafting and Revision Edition
Avatar for Kenji Saito ks91
PRO
0
180
ScoreMatchingRiesz for Automatic Debiased Machine Learning and Policy Path Estimation with an Application to Japanese Monetary Policy Evaluation
Avatar for MasaKat0 masakat0
0
230
製造業主導型経済からサービス経済化における中間層形成メカニズムのパラダイムシフト
Avatar for Masatake Yamoto yamotty
0
560
COFFEE-Japan PROJECT Impact Report（海ノ向こうコーヒー）
Avatar for 坂ノ途中 ontheslope
0
1.3k
SREはサイバネティクスの夢をみるか？ / Do SREs Dream of Cybernetics?
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
3
470
姫路市 -都市OSの「再実装」-
Avatar for Hopin hopin
0
1.7k
From Data Meshes to Data Spaces
Avatar for Posedio posedio
PRO
0
690
The mathematics of transformers
Avatar for Gabriel Peyré gpeyre
0
190

Featured

See All Featured
Fireside Chat
Avatar for paigeccino paigeccino
42
3.9k
Ecommerce SEO: The Keys for Success Now & Beyond - #SERPConf2024
Avatar for Aleyda Solis aleyda
1
1.9k
Paper Plane (Part 1)
Avatar for Katie Cordina Lindsey katiecoart
PRO
0
6.4k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.8k
How To Speak Unicorn (iThemes Webinar)
Avatar for Michelle Schulp Hunt marktimemedia
1
430
Designing for Timeless Needs
Avatar for Cassini Nazir cassininazir
0
190
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
Avatar for Sara Fernández Carmona sarafernandez
2
1.4k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.3k
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
Avatar for Yuki Nakata chikuwait chikuwait
0
450
Building Applications with DynamoDB
Avatar for Matt Wood mza
96
7k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
340
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.3k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology