Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
240
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
220
Stream Algorithmics
Avatar for Albert Bifet abifet
1
370
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
290
Ensemble Methods
Avatar for Albert Bifet abifet
0
250
Classification
Avatar for Albert Bifet abifet
0
330
Concept Drift
Avatar for Albert Bifet abifet
0
390

Other Decks in Research

See All in Research
SSII2025 [TS2] リモートセンシング画像処理の最前線
Avatar for 画像センシングシンポジウム ssii
PRO
7
2.9k
CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representations
Avatar for SatAI.challenge satai
3
220
最適化と機械学習による問題解決
Avatar for MIKIO KUBO mickey_kubo
0
140
とあるSREの博士「過程」 / A Certain SRE’s Ph.D. Journey
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
6
2.9k
[CV勉強会@関東 CVPR2025] VLM自動運転model S4-Driver
Avatar for Shin-kyoto shinkyoto
2
280
データサイエンティストの就労意識～2015→2024 一般（個人）会員アンケートより
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
720
90 分で学ぶ P 対 NP 問題
Avatar for E869120 e869120
18
7.6k
NLP2025参加報告会 LT資料
Avatar for Hayahide Yamagishi hargon24
1
330
SSII2025 [TS3] 医工連携における画像情報学研究
Avatar for 画像センシングシンポジウム ssii
PRO
2
1.2k
Google Agent Development Kit (ADK) 入門 🚀
Avatar for MIKIO KUBO mickey_kubo
2
1.2k
RapidPen: AIエージェントによるペネトレーションテスト 初期侵入全自動化の研究
Avatar for Sho Nakatani laysakura
0
1.6k
Pix2Poly: A Sequence Prediction Method for End-to-end Polygonal Building Footprint Extraction from Remote Sensing Imagery
Avatar for SatAI.challenge satai
3
500

Featured

See All Featured
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
72
4.9k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.7k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
430
65k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
332
24k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
69
11k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
90
590k
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
278
23k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
37
2.8k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
12k
A better future with KSS
Avatar for Kyle Neath kneath
238
17k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
200k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
524
40k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology