Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Albert Bifet
August 25, 2012
Research
1
240

Distributed Systems

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
abifet
1
210
Regression
abifet
0
220
Evaluation
abifet
1
180
Stream Algorithmics
abifet
1
320
Introduction to Data Stream Mining
abifet
1
200
Clustering
abifet
2
250
Ensemble Methods
abifet
0
190
Classification
abifet
0
290
Concept Drift
abifet
0
330

Other Decks in Research

See All in Research
marukotenant01/tenant-20240916
marketing2024
0
620
大規模言語モデルのバイアス
yukinobaba
PRO
4
760
第79回 産総研人工知能セミナー 発表資料
agiats
2
170
Composed image retrieval for remote sensing

satai
2
130
[依頼講演] 適応的実験計画法に基づく効率的無線システム設計
k_sato
0
170
20240918 交通くまもとーく 未来の鉄道網編（こねくま）
trafficbrain
0
340
論文紹介: COSMO: A Large-Scale E-commerce Common Sense Knowledge Generation and Serving System at Amazon (SIGMOD 2024)
ynakano
1
200
ニューラルネットワークの損失地形
joisino
PRO
36
18k
クロスセクター効果研究会　熊本都市交通リノベーション～「車1割削減、渋滞半減、公共交通2倍」の実現へ～
trafficbrain
0
290
Practical The One Person Framework
asonas
1
1.8k
データサイエンティストをめぐる環境の違い 2024年版〈一般ビジネスパーソン調査の国際比較〉
datascientistsociety
PRO
0
780
ミニ四駆AI用制御装置の事例紹介
aks3g
0
180

Featured

See All Featured
Into the Great Unknown - MozCon
thekraken
33
1.5k
Six Lessons from altMBA
skipperchong
27
3.5k
Put a Button on it: Removing Barriers to Going Fast.
kastner
59
3.6k
Designing Experiences People Love
moore
138
23k
Done Done
chrislema
181
16k
Why You Should Never Use an ORM
jnunemaker
PRO
54
9.1k
Testing 201, or: Great Expectations
jmmastey
40
7.1k
The Power of CSS Pseudo Elements
geoffreycrofte
73
5.4k
The Cost Of JavaScript in 2023
addyosmani
45
7k
Practical Orchestrator
shlominoach
186
10k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
45
2.2k
Designing on Purpose - Digital PM Summit 2013
jponch
116
7k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology