Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Albert Bifet
August 25, 2012
Research
1
140

Distributed Systems

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
abifet
1
120
Regression
abifet
0
120
Evaluation
abifet
1
93
Stream Algorithmics
abifet
1
180
Introduction to Data Stream Mining
abifet
1
160
Clustering
abifet
2
150
Ensemble Methods
abifet
0
110
Classification
abifet
0
170
Concept Drift
abifet
0
210

Other Decks in Research

See All in Research
地球の歩き方旅行記データセット － 文章中の人物の移動軌跡を実世界の地図上に接地する －
hiroki13
0
120
プロシージャ型処理を用いたステートレスな5Gコアネットワークの実現
hirokiwatanabe
0
300
zk-SPARQL: SPARQLクエリに対して検証とプライバシ保護が可能な結果を返すパーソナルRDFデータストア
yamdan
0
520
Segment Routingを用いたEPEの活用事例と GoBGPへの実装
wide_vsix
4
480
アナログが世界を救う? アナログコンピューティングの応用と課題
kentaroy47
0
170
データ分析の進め方とニュースメディアでのデータ活用事例 / data-analysis-in-kaggle-and-news-media
upura
0
570
[IR Reading 2022秋 論文紹介] Price DOES Matter!: Modeling Price and Interest Preferences in Session-based Recommendation (SIGIR 2022) /IR-Reading-2022-fall
koheishinden
3
120
Dangerous ‘Deep Decarbonization’ (Krebs PowerPoint to Cooler Heads Coalition)
gkehr1
0
780
コロナ禍だからこそ考えるオフラインコミュニティの意義 / significance of community
ariaki
0
940
卒業研究の進め方 / How to preceed with the research
shun74
1
110
Phishing Hunging Operations (PHOps)
tatsui
0
2.1k
Optimizing Electric Journal Subscriptions via Integer Programs
umepon
0
390

Featured

See All Featured
Why Our Code Smells
bkeepers
PRO
326
55k
GitHub's CSS Performance
jonrohan
1021
430k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
2
480
Music & Morning Musume
bryan
37
4.7k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
7
680
Done Done
chrislema
178
15k
How New CSS Is Changing Everything About Graphic Design on the Web
jensimmons
214
12k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
121
29k
The Invisible Customer
myddelton
113
12k
Product Roadmaps are Hard
iamctodd
38
7.9k
Embracing the Ebb and Flow
colly
76
3.6k
Imperfection Machines: The Place of Print at Facebook
scottboms
255
12k

Transcript

  1. Distributed Streaming
    Albert Bifet
    May 2012

    View Slide

  2. COMP423A/COMP523A Data Stream Mining
    Outline
    1. Introduction
    2. Stream Algorithmics
    3. Concept drift
    4. Evaluation
    5. Classification
    6. Ensemble Methods
    7. Regression
    8. Clustering
    9. Frequent Pattern Mining
    10. Distributed Streaming

    View Slide

  3. Data Streams
    Big Data & Real Time

    View Slide

  4. Distributed Systems
    Hadoop, S4 and Storm

    View Slide

  5. Hadoop
    Hadoop

    View Slide

  6. Hadoop
    Hadoop architecture

    View Slide

  7. Apache Mahout
    Mahout: open source framework

    View Slide

  8. Pig
    Pig: Similar to SQL

    View Slide

  9. Pig
    A = LOAD ’data’ USING PigStorage() AS
    (f1:int, f2:int, f3:int);
    B = GROUP A BY f1;
    C = FOREACH B GENERATE COUNT ($0);
    DUMP C;
    Pig: Similar to SQL

    View Slide

  10. Apache S4
    Apache S4

    View Slide

  11. Apache S4

    View Slide

  12. Storm
    Storm from Twitter

    View Slide

  13. Storm
    Stream, Spout, Bolt, Topology

    View Slide