Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Albert Bifet
August 25, 2012
Research
1
140

Distributed Systems

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
abifet
1
130
Regression
abifet
0
120
Evaluation
abifet
1
97
Stream Algorithmics
abifet
1
190
Introduction to Data Stream Mining
abifet
1
170
Clustering
abifet
2
150
Ensemble Methods
abifet
0
110
Classification
abifet
0
180
Concept Drift
abifet
0
220

Other Decks in Research

See All in Research
理科教育研究のパラダイム / Paradigms in Science Education Research
unzaih
0
130
[SPEASIP 2023招待講演] マルチスポット再生 meets 多言語ニューラル音声合成 ~実装 is ホンマに all we need~
takuma_okamoto
1
160
投資戦略202301
pw
1
490
コロナ禍だからこそ考えるオフラインコミュニティの意義 / significance of community
ariaki
0
1.1k
ふじみ子育てアンケートレポート VOl.2
yowata
0
140
ニューラル3次元復元入門
shunsukesaito
0
300
CSC570 Lecture 01
javiergs
PRO
0
140
様々なCPUアーキテクチャにおけるROP攻撃 / CSEC100
yumulab
0
250
Off-Policy Evaluation and Learning for Large Action Spaces via Conjunct Effect Modeling (ICML23)
usaito
PRO
0
350
AWS Mac も IaC したい! / AWS Mac also wants to IaC!
nttcom
0
350
[輪講資料] LoRA: Low-Rank Adaptation of
Large Language Models
hpprc
23
14k
20230326AJGEOG_GIS
tosseto
0
120

Featured

See All Featured
Building Better People: How to give real-time feedback that sticks.
wjessup
346
18k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
110
17k
Building Flexible Design Systems
yeseniaperezcruz
315
35k
Atom: Resistance is Futile
akmur
256
24k
Side Projects
sachag
450
38k
VelocityConf: Rendering Performance Case Studies
addyosmani
317
22k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
25
5.3k
jQuery: Nuts, Bolts and Bling
dougneiner
57
6.7k
Being A Developer After 40
akosma
49
580k
Git: the NoSQL Database
bkeepers
PRO
419
60k
The World Runs on Bad Software
bkeepers
PRO
59
5.9k
Building Applications with DynamoDB
mza
86
5.1k

Transcript

  1. Distributed Streaming
    Albert Bifet
    May 2012

    View Slide

  2. COMP423A/COMP523A Data Stream Mining
    Outline
    1. Introduction
    2. Stream Algorithmics
    3. Concept drift
    4. Evaluation
    5. Classification
    6. Ensemble Methods
    7. Regression
    8. Clustering
    9. Frequent Pattern Mining
    10. Distributed Streaming

    View Slide

  3. Data Streams
    Big Data & Real Time

    View Slide

  4. Distributed Systems
    Hadoop, S4 and Storm

    View Slide

  5. Hadoop
    Hadoop

    View Slide

  6. Hadoop
    Hadoop architecture

    View Slide

  7. Apache Mahout
    Mahout: open source framework

    View Slide

  8. Pig
    Pig: Similar to SQL

    View Slide

  9. Pig
    A = LOAD ’data’ USING PigStorage() AS
    (f1:int, f2:int, f3:int);
    B = GROUP A BY f1;
    C = FOREACH B GENERATE COUNT ($0);
    DUMP C;
    Pig: Similar to SQL

    View Slide

  10. Apache S4
    Apache S4

    View Slide

  11. Apache S4

    View Slide

  12. Storm
    Storm from Twitter

    View Slide

  13. Storm
    Stream, Spout, Bolt, Topology

    View Slide