Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
250
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
230
Stream Algorithmics
Avatar for Albert Bifet abifet
1
380
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
300
Ensemble Methods
Avatar for Albert Bifet abifet
0
250
Classification
Avatar for Albert Bifet abifet
0
330
Concept Drift
Avatar for Albert Bifet abifet
0
400

Other Decks in Research

See All in Research
SSII2025 [TS1] 光学・物理原理に基づく深層画像生成
Avatar for 画像センシングシンポジウム ssii
PRO
4
4.1k
在庫管理のための機械学習と最適化の融合
Avatar for MIKIO KUBO mickey_kubo
3
1.1k
集合間Bregmanダイバージェンスと置換不変NNによるその学習
Avatar for Takahiro Kawashima wasyro
0
130
A scalable, annual aboveground biomass product for monitoring carbon impacts of ecosystem restoration projects
Avatar for SatAI.challenge satai
3
150
数理最適化に基づく制御
Avatar for MIKIO KUBO mickey_kubo
6
710
Ad-DS Paper Circle #1
Avatar for Yusuke Kaneko ykaneko1992
0
5.8k
SSII2025 [TS2] リモートセンシング画像処理の最前線
Avatar for 画像センシングシンポジウム ssii
PRO
7
3k
診断前の病歴テキストを対象としたLLMによるエンティティリンキング精度検証
Avatar for Takashi Nishibayashi hagino3000
1
120
投資戦略202508
Avatar for Pragmaworks pw
0
150
Galileo: Learning Global & Local Features of Many Remote Sensing Modalities
Avatar for SatAI.challenge satai
3
140
Self-supervised audiovisual representation learning for remote sensing data
Avatar for SatAI.challenge satai
3
250
20250624_熊本経済同友会6月例会講演
Avatar for Traffic Brain trafficbrain
1
550

Featured

See All Featured
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
695
190k
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
332
24k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.5k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
351
21k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
7
810
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
6.7k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
51
3.4k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
70
11k
Fireside Chat
Avatar for paigeccino paigeccino
39
3.6k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology