Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
310
Regression
Avatar for Albert Bifet abifet
0
310
Evaluation
Avatar for Albert Bifet abifet
1
280
Stream Algorithmics
Avatar for Albert Bifet abifet
1
440
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
320
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
450

Other Decks in Research

See All in Research
NLP colloquium: AI Safety Survey
Avatar for Masahiro Kaneko kanekomasahiro
2
1.1k
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
370
Data Visualization Tools in the Age of AI
Avatar for Fritz Lekschas flekschas
0
200
重要だけど測れていないもの：高齢者ケアの見えない課題
Avatar for テオリア・テクノロジーズ theoriatec2024
0
520
Using our influence and power for patient safety
Avatar for Helen Bevan helenbevan
0
420
長時間動画QAにおけるマルチエージェント推論 ・SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration
Avatar for 村川卓也 murakawatakuya
1
200
JICA QUEST 共創×革新プログラム Impact Report（海ノ向こうコーヒー）
Avatar for 坂ノ途中 ontheslope
0
570
【Zozo Research 技術共有会】三次元領域の現在と展望
Avatar for 小島瑞貴 mickey_0226
3
610
MIRU2026 チュートリアル講演2：三次元データ処理の動向
Avatar for Naoya Chiba nnchiba
6
4.8k
研究室単位での自律的 IPv6接続性確立に向けたAS共同運用モデルの提案と実証
Avatar for Hiroki (REO) Kashiwazaki reokashiwa
PRO
0
210
VLMの推論を高速化する視覚トークン削減の仕組み
Avatar for tattaka tattaka
2
310
AIエージェント時代のLLM-jpモデルのあるべき姿
Avatar for Kouta Nakayama k141303
0
630

Featured

See All Featured
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
12k
Navigating Team Friction
Avatar for Lara Hogan lara
192
16k
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
Avatar for Sara Fernández Carmona sarafernandez
0
270
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
66
8.6k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
128
18k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
270
14k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.8k
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
370
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
464
34k
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
Avatar for r-kagaya rkaga
63
46k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
35k
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
63k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology