Lock in $30 Savings on PRO—Offer Ends Soon! ⏳

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
280

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
260
Regression
Avatar for Albert Bifet abifet
0
270
Evaluation
Avatar for Albert Bifet abifet
1
240
Stream Algorithmics
Avatar for Albert Bifet abifet
1
400
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
310
Ensemble Methods
Avatar for Albert Bifet abifet
0
280
Classification
Avatar for Albert Bifet abifet
0
350
Concept Drift
Avatar for Albert Bifet abifet
0
420

Other Decks in Research

See All in Research
IMC の細かすぎる話 2025
Avatar for @smly smly
2
780
機械学習と数理最適化の融合 (MOAI) による革新
Avatar for MIKIO KUBO mickey_kubo
1
430
その推薦システムの評価指標、ユーザーの感覚とズレてるかも
Avatar for kuri8ive kuri8ive
1
270
超高速データサイエンス
Avatar for Yusuke Matsui matsui_528
1
310
離散凸解析に基づく予測付き離散最適化手法 (IBIS '25)
Avatar for Taihei OKI taihei_oki
PRO
1
620
教師あり学習と強化学習で作る 最強の数学特化LLM
Avatar for Hiroshi Y (RabotniKuma) analokmaus
2
730
不確実性下における目的と手段の統合的探索に向けた連続腕バンディットの応用 / iot70_gp_rff_mab
Avatar for monochromegane monochromegane
2
250
大学見本市2025 JSTさきがけ事業セミナー「顔の見えないセンシング技術：多様なセンサにもとづく個人情報に配慮した人物状態推定」
Avatar for Mariko Isogawa miso2024
0
190
Multi-Agent Large Language Models for Code Intelligence: Opportunities, Challenges, and Research Directions
Avatar for Fatemeh Fard (UBC) fatemeh_fard
0
110
高畑鬼界ヶ島と重文・称名寺本薬師如来像の来歴を追って/kikaigashima
Avatar for Code for History kochizufan
0
100
Nullspace MPC
Avatar for MizuhoAOKI mizuhoaoki
1
480
能動適応的実験計画
Avatar for MasaKat0 masakat0
2
1.1k

Featured

See All Featured
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
510
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.3k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
26
3.2k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
Done Done
Avatar for chrislema chrislema
186
16k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.2k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
196
70k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.5k
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
463
34k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
61k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology