Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
310
Regression
Avatar for Albert Bifet abifet
0
310
Evaluation
Avatar for Albert Bifet abifet
1
280
Stream Algorithmics
Avatar for Albert Bifet abifet
1
440
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
320
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
450

Other Decks in Research

See All in Research
横浜市長（山中氏）の言動にかかる第三者による調査報告書
Avatar for Sayaka Ishizuka y150saya
0
390
Apache Gravitinoで実現する Icebergカタログ統合とアクセスの一元化
Avatar for matsumooon matsumooon
0
530
Ghost in the 7‑Zip: The Shadow of Residential Proxies Creeping into Your Life
Avatar for NTT docomo Business nttcom
0
2.1k
シングルチャネルマルチトーカー音声認識の進展
Avatar for Ryo Masumura ryomasumura
0
320
進化？迷走？CasualConc ファミリーアプリの現在地 @ 英語コーパス学会 2026
Avatar for Yasu Imao casualconc
0
110
LA-Bench 2025：実験指示から 実行可能手順を生成するためのデータセット/LA-Bench 2025: A Dataset for Generating Executable Experimental Procedures from Experimental Instructions
Avatar for Shota Kato stktu
0
190
LLM の Attention 機構まとめ — 数式・計算量・メモリ
Avatar for プワー puwaer
8
2.8k
量子サマースクール2026「量子計算機アーキテクチャ分野の概観」
Avatar for Yosuke Ueno youten622
1
910
CDCL を用いた MILP の厳密解法
Avatar for 今井義弥 imai448
0
270
[CV勉強会＠関東 CVPR2026] PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow / kantocv 67th CVPR 2026
Avatar for Shunsuke KITADA shunk031
0
350
2025年度秋葉原ウォーカブルプロジェクト調査報告 「アキバらしいウォーカブル」とは何か
Avatar for 日本大学 都市計画研究室（泉山ゼミ） izumiyama_lab
1
230
SOTAのさらに先へ：厳しい推論制約下での高性能モデルのPost-Training
Avatar for Hiroshi Y (RabotniKuma) analokmaus
0
1.6k

Featured

See All Featured
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
356
21k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.8k
Building Applications with DynamoDB
Avatar for Matt Wood mza
96
7.2k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
4k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
47
8.3k
HDC tutorial
Avatar for Michiel Stock michielstock
2
880
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
520
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.5k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
10
1.3k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
Avatar for Tech SEO Connect techseoconnect
PRO
0
440
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.5k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology