Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
310
Regression
Avatar for Albert Bifet abifet
0
300
Evaluation
Avatar for Albert Bifet abifet
1
280
Stream Algorithmics
Avatar for Albert Bifet abifet
1
440
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
320
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
450

Other Decks in Research

See All in Research
計算情報学研究室 （数理情報学第７研究室）2026
Avatar for Tomohiro tomohirokoana
0
770
EIRによる不正端末のブロッキング 5G時代におけるデバイス識別と不正対策の進化
Avatar for Stellar Craft, Inc. stellarcraft
0
120
IA for theory
Avatar for Gabriel Peyré gpeyre
1
360
超効率化への挑戦：1bit LLMの現状と展望
Avatar for Yuma Ichikawa yumaichikawa
0
490
医療LLMの現在地〜最新研究から社会実装までを考える〜
Avatar for kento sugimoto kento1109
1
1.7k
MM-OVSeg: Multimodal Optical–SAR Fusion for Open-Vocabulary Segmentation in Remote Sensing
Avatar for SatAI.challenge satai
3
110
MIRU2026 チュートリアル講演2：三次元データ処理の動向
Avatar for Naoya Chiba nnchiba
6
4.3k
Fukui Shibiten 39 - AI Art
Avatar for IWABUCHI Yu(u)ki butchi butchi
0
180
SLAMはどこまで解決されたのか？
Avatar for tomonom tomonom
0
1.2k
National high-resolution cropland classification of Japan with agricultural census information and multi-temporal multi-modality datasets
Avatar for SatAI.challenge satai
3
450
ros2-perf-multihost: 分散システムにおける客観的なアーキテクチャ評価フレームワーク
Avatar for takasehideki takasehideki
0
210
AGI4OPT:自然言語から数理最適化を導くエ ージェントスキル Translating Human Intent into Mathematical Optimization
Avatar for MIKIO KUBO mickey_kubo
0
180

Featured

See All Featured
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1369
210k
Side Projects
Avatar for Sacha Greif sachag
455
43k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
45
9.2k
Information Architects: The Missing Link in Design Systems
Avatar for Michelle Chin soysaucechin
1
1.1k
brightonSEO & MeasureFest 2025 - Christian Goodrich - Winning strategies for Black Friday CRO & PPC
Avatar for Christian Goodrich cargoodrich
3
780
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
66
8.5k
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.2k
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
1
530
Paper Plane
Avatar for Katie Cordina Lindsey katiecoart
PRO
2
53k
Paper Plane (Part 1)
Avatar for Katie Cordina Lindsey katiecoart
PRO
1
10k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
3k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology