Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Albert Bifet
August 25, 2012
Research
1
250

Distributed Systems

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
abifet
1
220
Regression
abifet
0
230
Evaluation
abifet
1
200
Stream Algorithmics
abifet
1
340
Introduction to Data Stream Mining
abifet
1
210
Clustering
abifet
2
260
Ensemble Methods
abifet
0
210
Classification
abifet
0
300
Concept Drift
abifet
0
350

Other Decks in Research

See All in Research
2038年問題が思ったよりヤバい。検出ツールを作って脅威性評価してみた論文 | Kansai Open Forum 2024
ran350
8
3.8k
CoRL2024サーベイ
rpc
1
1.5k
文書画像のデータ化における VLM活用 / Use of VLM in document image data conversion
sansan_randd
2
500
Tiaccoon: コンテナネットワークにおいて複数トランスポート方式で統一的なアクセス制御
hiroyaonoe
0
410
Satellite Sunroof: High-res Digital Surface Models and Roof Segmentation for Global Solar Mapping
satai
2
130
機械学習でヒトの行動を変える
hiromu1996
1
530
Weekly AI Agents News! 10月号 プロダクト/ニュースのアーカイブ
masatoto
1
190
渋谷Well-beingアンケート調査結果
shibuyasmartcityassociation
0
400
チュートリアル：Mamba, Vision Mamba (Vim)
hf149
6
2.1k
[輪講] Transformer Layers as Painters
nk35jk
4
650
ソフトウェア研究における脅威モデリング
laysakura
0
1.6k
情報処理学会関西支部2024年度定期講演会「自然言語処理と大規模言語モデルの基礎」
ksudoh
10
2.5k

Featured

See All Featured
Making the Leap to Tech Lead
cromwellryan
133
9.1k
A Modern Web Designer's Workflow
chriscoyier
693
190k
The Cult of Friendly URLs
andyhume
78
6.2k
Designing for Performance
lara
604
68k
Code Reviewing Like a Champion
maltzj
521
39k
Building Applications with DynamoDB
mza
93
6.2k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
10
1.3k
Making Projects Easy
brettharned
116
6k
Intergalactic Javascript Robots from Outer Space
tanoku
270
27k
BBQ
matthewcrist
87
9.5k
What’s in a name? Adding method to the madness
productmarketing
PRO
22
3.3k
Speed Design
sergeychernyshev
27
790

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology