Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
280

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
260
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
230
Stream Algorithmics
Avatar for Albert Bifet abifet
1
390
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
310
Ensemble Methods
Avatar for Albert Bifet abifet
0
260
Classification
Avatar for Albert Bifet abifet
0
340
Concept Drift
Avatar for Albert Bifet abifet
0
410

Other Decks in Research

See All in Research
Towards a More Efficient Reasoning LLM: AIMO2 Solution Summary and Introduction to Fast-Math Models
Avatar for Hiroshi Y (RabotniKuma) analokmaus
2
960
MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
Avatar for SatAI.challenge satai
4
360
Nullspace MPC
Avatar for MizuhoAOKI mizuhoaoki
1
230
20250605_新交通システム推進議連_熊本都市圏「車1割削減、渋滞半減、公共交通2倍」から考える地方都市交通政策
Avatar for Traffic Brain trafficbrain
0
910
ロボット学習における大規模検索技術の展開と応用
Avatar for Mai Nishimura denkiwakame
1
140
[CV勉強会@関東 CVPR2025] VLM自動運転model S4-Driver
Avatar for Shin-kyoto shinkyoto
2
550
地域丸ごとデイサービス「Go トレ」の紹介
Avatar for SMARTふくしラボ smartfukushilab1
0
270
Language Models Are Implicitly Continuous
Avatar for Sho Yokoi eumesy
PRO
0
310
大学見本市2025 JSTさきがけ事業セミナー「顔の見えないセンシング技術：多様なセンサにもとづく個人情報に配慮した人物状態推定」
Avatar for Mariko Isogawa miso2024
0
170
「どう育てるか」より「どう働きたいか」〜スクラムマスターの最初の一歩〜
Avatar for hirakawa hirakawa51
0
970
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
820
J-RAGBench: 日本語RAGにおける Generator評価ベンチマークの構築
Avatar for Koki Itai koki_itai
0
850

Featured

See All Featured
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
173
15k
Sharpening the Axe: The Primacy of Toolmaking
Avatar for Bryan Cantrill bcantrill
46
2.5k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
Navigating Team Friction
Avatar for Lara Hogan lara
190
15k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
32
1.2k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
34
2.3k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
431
66k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
88
4.9k
What’s in a name? Adding method to the madness
Avatar for Product Marketing Alliance productmarketing
PRO
24
3.7k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
9.7k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
355
21k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology