Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
250
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
230
Stream Algorithmics
Avatar for Albert Bifet abifet
1
380
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
300
Ensemble Methods
Avatar for Albert Bifet abifet
0
250
Classification
Avatar for Albert Bifet abifet
0
330
Concept Drift
Avatar for Albert Bifet abifet
0
400

Other Decks in Research

See All in Research
数理最適化と機械学習の融合
Avatar for MIKIO KUBO mickey_kubo
15
9.1k
When Submarine Cables Go Dark: Examining the Web Services Resilience Amid Global Internet Disruptions
Avatar for Irvin Chen irvin
0
280
PhD Defense 2025: Visual Understanding of Human Hands in Interactions
Avatar for Take Ohkawa tkhkaeio
1
140
Generative Models 2025
Avatar for Hiroshi Takahashi takahashihiroshi
23
13k
Submeter-level land cover mapping of Japan
Avatar for SatAI.challenge satai
3
200
集合間Bregmanダイバージェンスと置換不変NNによるその学習
Avatar for Takahiro Kawashima wasyro
0
130
SSII2025 [TS1] 光学・物理原理に基づく深層画像生成
Avatar for 画像センシングシンポジウム ssii
PRO
4
4.1k
時系列データに対する解釈可能な 決定木クラスタリング
Avatar for MIKIO KUBO mickey_kubo
2
870
能動適応的実験計画
Avatar for MasaKat0 masakat0
2
760
問いを起点に、社会と共鳴する知を育む場へ
Avatar for MATSUMOTO Ryosuke matsumoto_r
PRO
0
560
引力・斥力を制御可能なランダム部分集合の確率分布
Avatar for Takahiro Kawashima wasyro
0
220
「エージェントって何？」から「実際の開発現場で役立つ考え方やベストプラクティス」まで
Avatar for MIKIO KUBO mickey_kubo
0
140

Featured

See All Featured
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
5.7k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.4k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
695
190k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
30
9.6k
KATA
Avatar for Megan Lloyd mclloyd
32
14k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
53
8.8k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
51
3.4k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
36
6.8k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
301
21k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology