Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
310
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
300
Regression
Avatar for Albert Bifet abifet
0
300
Evaluation
Avatar for Albert Bifet abifet
1
280
Stream Algorithmics
Avatar for Albert Bifet abifet
1
440
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
320
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
450

Other Decks in Research

See All in Research
typst の使い方：言語学を研究する学生のために
Avatar for Tomoya gitomochang
0
540
PGDM: Physically Guided Diffusion Model for L Downscaling
Avatar for SatAI.challenge satai
3
400
セマンティック通信勉強会 6Gに向けたデバイス間効率的な通信の技術紹介・課題・今後展望
Avatar for SatAI.challenge satai
3
270
全国町字単位空き家率推定データver1.0データ仕様
Avatar for microbase microbaseinc
0
180
Google Cloud Next 2026 DM Recap Agentic Data Cloudを添えて / Google Cloud Next 2026 DM Recap
Avatar for nnaka2992 nnaka2992
0
110
長時間動画QAにおけるマルチエージェント推論 ・SVAgent: Storyline-Guided Long Video Understanding via Cross-Modal Multi-Agent Collaboration
Avatar for 村川卓也 murakawatakuya
1
180
kintone リサーチ副部/UXリサーチャー 業務紹介
Avatar for Cybozu cybozuinsideout
PRO
0
130
Model Discovery and Graph Simulation: A Lightweight Gateway to Chaos Engineering
Avatar for Anatoly A. Krasnovsky anatolykr
0
250
HAKARI-Bench - 実運用視点での情報検索モデル評価ベンチマーク
Avatar for Yuichi Tateno hotchpotch
1
650
EIRによる不正端末のブロッキング 5G時代におけるデバイス識別と不正対策の進化
Avatar for Stellar Craft, Inc. stellarcraft
0
110
研究室単位での自律的 IPv6接続性確立に向けたAS共同運用モデルの提案と実証
Avatar for Hiroki (REO) Kashiwazaki reokashiwa
PRO
0
190
第64回CV・PRML勉強会　論文紹介：Linguistic Priors for Visual Decoupling: Towards Symmetric Vision-Brain Alignment
Avatar for Soki Katayama sokikatayama
0
150

Featured

See All Featured
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
6
1.2k
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
1
2.3k
Test your architecture with Archunit
Avatar for Yoan thirion
1
2.3k
Marketing to machines
Avatar for Jono Alderson jonoalderson
1
5.7k
Lessons Learnt from Crawling 1000+ Websites
Avatar for Charles Meaden charlesmeaden
PRO
1
1.5k
We Analyzed 250 Million AI Search Results: Here's What I Found
Avatar for Josh Blyskal joshbly
1
1.8k
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
8
36k
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
Avatar for r-kagaya rkaga
63
45k
Information Architects: The Missing Link in Design Systems
Avatar for Michelle Chin soysaucechin
0
1.1k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Sam Torres - BigQuery for SEOs
Avatar for Tech SEO Connect techseoconnect
PRO
0
460

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology