$30 off During Our Annual Pro Sale. View Details »

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
280

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
260
Regression
Avatar for Albert Bifet abifet
0
270
Evaluation
Avatar for Albert Bifet abifet
1
240
Stream Algorithmics
Avatar for Albert Bifet abifet
1
390
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
250
Clustering
Avatar for Albert Bifet abifet
2
310
Ensemble Methods
Avatar for Albert Bifet abifet
0
270
Classification
Avatar for Albert Bifet abifet
0
350
Concept Drift
Avatar for Albert Bifet abifet
0
410

Other Decks in Research

See All in Research
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1k
ウェブ・ソーシャルメディア論文読み会 第31回: The rising entropy of English in the attention economy. (Commun Psychology, 2024)
Avatar for taichi_murayama hkefka385
1
120
一人称視点映像解析の最先端（MIRU2025 チュートリアル）
Avatar for Takuma Yagi takumayagi
6
4.3k
財務諸表監査のための逐次検定
Avatar for MasaKat0 masakat0
0
200
SREのためのテレメトリー技術の探究 / Telemetry for SRE
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
12
2.2k
Satellites Reveal Mobility: A Commuting Origin-destination Flow Generator for Global Cities
Avatar for SatAI.challenge satai
3
160
Open Gateway 5GC利用への期待と不安
Avatar for Stellar Craft, Inc. stellarcraft
2
160
スキマバイトサービスにおける現場起点でのデザインアプローチ
Avatar for 眞行寺由郎 yoshioshingyouji
0
270
MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
Avatar for SatAI.challenge satai
4
460
単施設でできる臨床研究の考え方
Avatar for Shuntaro Sato shuntaros
0
3.3k
When Learned Data Structures Meet Computer Vision
Avatar for Yusuke Matsui matsui_528
1
890
SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Images
Avatar for SatAI.challenge satai
3
450

Featured

See All Featured
Fireside Chat
Avatar for paigeccino paigeccino
41
3.7k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.7k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.3k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.4k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
34
2.5k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
54k
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
12
960
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
21
1.3k
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
60
9.6k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
132
19k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology