Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
240
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
220
Stream Algorithmics
Avatar for Albert Bifet abifet
1
370
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
290
Ensemble Methods
Avatar for Albert Bifet abifet
0
240
Classification
Avatar for Albert Bifet abifet
0
330
Concept Drift
Avatar for Albert Bifet abifet
0
380

Other Decks in Research

See All in Research
言語モデルによるAI創薬の進展 / Advancements in AI-Driven Drug Discovery Using Language Models
Avatar for tsurubee tsurubee
2
360
学生向けアンケート＜データサイエンティストについて＞
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
2.1k
Agentic AIとMCPを利用したサービス作成入門
Avatar for MIKIO KUBO mickey_kubo
0
150
GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localization
Avatar for SatAI.challenge satai
3
200
AIによる画像認識技術の進化 -25年の技術変遷を振り返る-
Avatar for Hironobu Fujiyoshi hf149
6
2.9k
[輪講] SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features
Avatar for Naoki Kato nk35jk
2
330
Vision Language Modelと完全自動運転AIの最新動向
Avatar for Tsubasa Takahashi tsubasashi
2
650
大規模な2値整数計画問題に対する 効率的な重み付き局所探索法
Avatar for MIKIO KUBO mickey_kubo
1
170
SSII2025 [TS2] リモートセンシング画像処理の最前線
Avatar for 画像センシングシンポジウム ssii
PRO
6
2.5k
MGDSS：慣性式モーションキャプチャを用いたジェスチャによるドローンの操作 / ec75-yamauchi
Avatar for yumulab yumulab
0
200
SkySense : A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery
Avatar for SatAI.challenge satai
3
190
ASSADS：ASMR動画に合わせて撫でられる感覚を提示するシステムの開発と評価 / ec75-shimizu
Avatar for yumulab yumulab
1
290

Featured

See All Featured
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
231
18k
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
10
860
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
130
19k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
14
1.5k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
9
610
Building an army of robots
Avatar for Kyle Neath kneath
306
45k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
8
760
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
137
34k
Faster Mobile Websites
Avatar for Dean Hume deanohume
307
31k
What’s in a name? Adding method to the madness
Avatar for Product Marketing Alliance productmarketing
PRO
22
3.5k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
1
96
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology