Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
250
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
230
Stream Algorithmics
Avatar for Albert Bifet abifet
1
380
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
300
Ensemble Methods
Avatar for Albert Bifet abifet
0
260
Classification
Avatar for Albert Bifet abifet
0
340
Concept Drift
Avatar for Albert Bifet abifet
0
400

Other Decks in Research

See All in Research
snlp2025_prevent_llm_spikes
Avatar for Sho Takase takase
0
350
Stealing LUKS Keys via TPM and UUID Spoofing in 10 Minutes - BSides 2025
Avatar for AnyKeyShik anykeyshik
0
130
GPUを利用したStein Particle Filterによる点群6自由度モンテカルロSLAM
Avatar for TakumiNakao takuminakao
0
350
Mechanistic Interpretability：解釈可能性研究の新たな潮流
Avatar for Koshiro Aoki koshiro_aoki
1
440
AWSで実現した大規模日本語VLM学習用データセット "MOMIJI" 構築パイプライン/buiding-momiji
Avatar for 開発室Graph studio_graph
2
640
Minimax and Bayes Optimal Best-arm Identification: Adaptive Experimental Design for Treatment Choice
Avatar for MasaKat0 masakat0
0
180
EarthSynth: Generating Informative Earth Observation with Diffusion Models
Avatar for SatAI.challenge satai
3
360
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
62
30k
Towards a More Efficient Reasoning LLM: AIMO2 Solution Summary and Introduction to Fast-Math Models
Avatar for Hiroshechka Y analokmaus
2
870
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
0
190
問いを起点に、社会と共鳴する知を育む場へ
Avatar for MATSUMOTO Ryosuke matsumoto_r
PRO
0
640
Large Language Model Agent: A Survey on Methodology, Applications and Challenges
Avatar for Shunsuke KITADA shunk031
17
10k

Featured

See All Featured
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
11
880
Faster Mobile Websites
Avatar for Dean Hume deanohume
310
31k
Code Review Best Practice
Avatar for Trisha Gee trishagee
72
19k
Fireside Chat
Avatar for paigeccino paigeccino
40
3.7k
Sharpening the Axe: The Primacy of Toolmaking
Avatar for Bryan Cantrill bcantrill
45
2.5k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
339
57k
Visualization
Avatar for Eitan Lees eitanlees
148
16k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
43
7.7k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
9.7k
How GitHub (no longer) Works
Avatar for Zach Holman holman
315
140k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology