Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
310
Regression
Avatar for Albert Bifet abifet
0
310
Evaluation
Avatar for Albert Bifet abifet
1
280
Stream Algorithmics
Avatar for Albert Bifet abifet
1
440
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
280
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
320
Classification
Avatar for Albert Bifet abifet
0
390
Concept Drift
Avatar for Albert Bifet abifet
0
460

Other Decks in Research

See All in Research
GeoAgent勉強会 論文紹介と強い推論モデルが与えるインパクト
Avatar for SatAI.challenge satai
5
390
実例から見るLLMのマンガ理解：実務VQAタスクによる長期的文脈と視覚情報の定性評価
Avatar for kzmssk kzmssk
0
190
[CV勉強会＠関東 CVPR2026] PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow / kantocv 67th CVPR 2026
Avatar for Shunsuke KITADA shunk031
0
380
J-STAGEの現況と全文XML登載必須化について
Avatar for XSPA xspa2012
0
340
モデル評価を効率的にする方法
Avatar for fumihiko takahashi ftakahashi
0
230
[最先端NLP勉強会2026] Checklists Are Better Than Reward Models For Aligning Language Models
Avatar for Kento Nozawa nzw0301
1
330
Byzantine Eventual Consistency for Reliable Local-First Software
Avatar for Martin Kleppmann ept
0
230
Bilan travail en élevage : première restitution des enquêtes 2025-2026
Avatar for Idele institutdelelevage
PRO
0
110
山中市政が招いた組織崩壊：よこはま安心ボックスを例に
Avatar for sishi sishi
0
350
長時間動画QAにおけるマルチエージェント推論 ・SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration
Avatar for 村川卓也 murakawatakuya
1
230
Language and AI
Avatar for Ayana Niwa ayaniwa
0
320
山中市政の総括：相反する二つの顔
Avatar for sishi sishi
0
220

Featured

See All Featured
Abbi's Birthday
Avatar for Violet Bock coloredviolet
4
10k
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
61
10k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
62k
We Are The Robots
Avatar for Honza Javorek honzajavorek
0
400
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
410
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1033
470k
Leveraging LLMs for student feedback in introductory data science courses - posit::conf(2025)
Avatar for Mine Cetinkaya-Rundel minecr
1
440
Darren the Foodie - Storyboard
Avatar for Kevinho.art khoart
PRO
4
4k
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
2
630
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
77
5.6k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
433
67k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology