Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
290

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
270
Regression
Avatar for Albert Bifet abifet
0
280
Evaluation
Avatar for Albert Bifet abifet
1
240
Stream Algorithmics
Avatar for Albert Bifet abifet
1
400
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
320
Ensemble Methods
Avatar for Albert Bifet abifet
0
290
Classification
Avatar for Albert Bifet abifet
0
350
Concept Drift
Avatar for Albert Bifet abifet
0
420

Other Decks in Research

See All in Research
「リアル×スキマ時間」​を活用したUXリサーチ ​〜新規事業を前に進めるためのUXリサーチプロセスの設計〜
Avatar for PERSOL CAREER Dev | techtekt techtekt
PRO
0
230
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
Avatar for Yuki Nakata chikuwait chikuwait
0
270
データサイエンティストをめぐる環境の違い2025年版〈一般ビジネスパーソン調査の国際比較〉
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
450
【NICOGRAPH2025】Photographic Conviviality: ボディペイント・ワークショップによる 同時的かつ共生的な写真体験
Avatar for Chinatsu Ozawa toremolo72
0
110
一般道の交通量減少と速度低下についての全国分析と熊本市におけるケーススタディ（20251122 土木計画学研究発表会）
Avatar for Traffic Brain trafficbrain
0
110
Language Models Are Implicitly Continuous
Avatar for Sho Yokoi eumesy
PRO
0
370
競合や要望に流されない─B2B SaaSでミニマム要件を決めるリアルな取り組み / Don't be swayed by competitors or requests - A real effort to determine minimum requirements for B2B SaaS
Avatar for 株式会社カミナシ kaminashi
0
460
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.1k
教師あり学習と強化学習で作る 最強の数学特化LLM
Avatar for Hiroshi Y (RabotniKuma) analokmaus
2
820
SkySense V2: A Unified Foundation Model for Multi-modal Remote Sensing
Avatar for SatAI.challenge satai
3
320
AWSの耐久性のあるRedis互換KVSのMemoryDBについての論文を読んでみた
Avatar for bootjp / ぶーと bootjp
1
400
Can AI Generated Ambrotype Chain the Aura of Alternative Process? In SIGGRAPH Asia 2024 Art Papers
Avatar for Chinatsu Ozawa toremolo72
0
120

Featured

See All Featured
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.5k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k
The SEO identity crisis: Don't let AI make you average
Avatar for Varn varn
0
46
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
DevOps and Value Stream Thinking: Enabling flow, efficiency and business value
Avatar for Helen Beal helenjbeal
1
76
The Hidden Cost of Media on the Web [PixelPalooza 2025]
Avatar for Tammy Everts tammyeverts
2
130
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
61k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
190
11k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
330
Money Talks: Using Revenue to Get Sh*t Done
Avatar for Nikki Halliwell nikkihalliwell
0
130

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology