Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
310
Regression
Avatar for Albert Bifet abifet
0
310
Evaluation
Avatar for Albert Bifet abifet
1
280
Stream Algorithmics
Avatar for Albert Bifet abifet
1
440
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
320
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
450

Other Decks in Research

See All in Research
PGDM: Physically Guided Diffusion Model for L Downscaling
Avatar for SatAI.challenge satai
3
450
データサイエンティストの就労意識～2015 → 2026 一般(個人)会員アンケートより
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
730
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
360
【中間報告】国会議員の立法・政策実務を支える環境を巡る現状と課題
Avatar for 株式会社PoliPoli/PoliPoli.Inc polipoli
0
530
大規模言語モデルは誰を覚えているか / Who Do Large Language Models Memorize?
Avatar for Shotaro Ishihara upura
0
150
Pretrain Where? Investigating How Pretraining Data Diversity Impacts Geospatial Foundation Model Performance
Avatar for SatAI.challenge satai
3
110
シングルチャネルマルチトーカー音声認識の進展
Avatar for Ryo Masumura ryomasumura
0
240
Research Engineerという仕事 / Research Engineering: Bridging Research and Business
Avatar for chck chck
1
290
Data Visualization Tools in the Age of AI
Avatar for Fritz Lekschas flekschas
0
200
2026年 オープンキャンパス 研究室紹介
Avatar for Jun Kurihara junkurihara
0
160
マーケットストリート 社会実験2024 in 秋葉原ジャンク通り 調査報告書
Avatar for 日本大学 都市計画研究室（泉山ゼミ） izumiyama_lab
1
130
ros2-perf-multihost: 分散システムにおける客観的なアーキテクチャ評価フレームワーク
Avatar for takasehideki takasehideki
0
230

Featured

See All Featured
Have SEOs Ruined the Internet? - User Awareness of SEO in 2025
Avatar for Akash Hashmi akashhashmi
0
460
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
220k
WCS-LA-2024
Avatar for Leonardo Collado-Torres lcolladotor
0
820
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
A better future with KSS
Avatar for Kyle Neath kneath
240
18k
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
Avatar for Katarina Dahlin katarinadahlin
PRO
2
3.8k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
331
25k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
1.5k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
133
19k
Navigating Team Friction
Avatar for Lara Hogan lara
192
16k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
356
21k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology