Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Albert Bifet
August 25, 2012
Research
1
260

Distributed Systems

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
abifet
1
220
Regression
abifet
0
230
Evaluation
abifet
1
200
Stream Algorithmics
abifet
1
340
Introduction to Data Stream Mining
abifet
1
220
Clustering
abifet
2
270
Ensemble Methods
abifet
0
220
Classification
abifet
0
310
Concept Drift
abifet
0
360

Other Decks in Research

See All in Research
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
de9uch1
0
120
ECCV2024読み会: Minimalist Vision with Freeform Pixels
hsmtta
1
440
ドローンやICTを活用した持続可能なまちづくりに関する研究
nro2daisuke
0
160
Weekly AI Agents News! 11月号 プロダクト/ニュースのアーカイブ
masatoto
0
310
NeurIPS 2024 参加報告 & 論文紹介 (SACPO, Ctrl-G)
reisato12345
0
360
Leveraging LLMs for Unsupervised Dense Retriever Ranking (SIGIR 2024)
kampersanda
2
310
インドネシアのQA事情を紹介するの
yujijs
0
120
サーブレシーブ成功率は勝敗に影響するか？
vball_panda
0
550
A Segment Anything Model based weakly supervised learning method for crop mapping using Sentinel-2 time series images
satai
3
160
[ECCV2024読み会] 衛星画像からの地上画像生成
elith
1
1.1k
BtoB プロダクトにおけるインサイトマネジメントの必要性 現場ドリブンなカミナシがインサイトマネジメントに取り組むワケ / Why field-driven Kaminashi is working on insight management
kaminashi
1
310
国際会議ACL2024参加報告
chemical_tree
1
450

Featured

See All Featured
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
The Pragmatic Product Professional
lauravandoore
32
6.4k
Producing Creativity
orderedlist
PRO
344
40k
Documentation Writing (for coders)
carmenintech
69
4.6k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Become a Pro
speakerdeck
PRO
26
5.2k
Building an army of robots
kneath
303
45k
Build your cross-platform service in a week with App Engine
jlugia
229
18k
Why Our Code Smells
bkeepers
PRO
336
57k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.2k
KATA
mclloyd
29
14k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
28
9.3k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology