Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
1
270

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012
Tweet

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
250
Regression
Avatar for Albert Bifet abifet
0
260
Evaluation
Avatar for Albert Bifet abifet
1
230
Stream Algorithmics
Avatar for Albert Bifet abifet
1
380
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
240
Clustering
Avatar for Albert Bifet abifet
2
300
Ensemble Methods
Avatar for Albert Bifet abifet
0
260
Classification
Avatar for Albert Bifet abifet
0
340
Concept Drift
Avatar for Albert Bifet abifet
0
400

Other Decks in Research

See All in Research
時系列データに対する解釈可能な 決定木クラスタリング
Avatar for MIKIO KUBO mickey_kubo
2
1k
2021年度-基盤研究B-研究計画調書
Avatar for Y. Yamamoto trycycle
PRO
0
330
Creation and environmental applications of 15-year daily inundation and vegetation maps for Siberia by integrating satellite and meteorological datasets
Avatar for SatAI.challenge satai
3
380
最適化と機械学習による問題解決
Avatar for MIKIO KUBO mickey_kubo
0
180
VectorLLM: Human-like Extraction of Structured Building Contours via Multimodal LLMs
Avatar for SatAI.challenge satai
4
310
長期・短期メモリを活用したエージェントの個別最適化
Avatar for AITC - DENTSU SOKEN isidaitc
0
160
Agentic AIとMCPを利用したサービス作成入門
Avatar for MIKIO KUBO mickey_kubo
0
630
まずはここから：Overleaf共同執筆・CopilotでAIコーディング入門・Codespacesで独立環境
Avatar for Yusuke Matsui matsui_528
2
580
Towards a More Efficient Reasoning LLM: AIMO2 Solution Summary and Introduction to Fast-Math Models
Avatar for Hiroshechka Y analokmaus
2
870
A scalable, annual aboveground biomass product for monitoring carbon impacts of ecosystem restoration projects
Avatar for SatAI.challenge satai
4
340
MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
Avatar for SatAI.challenge satai
4
300
AWSで実現した大規模日本語VLM学習用データセット "MOMIJI" 構築パイプライン/buiding-momiji
Avatar for 開発室Graph studio_graph
2
640

Featured

See All Featured
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
53k
Faster Mobile Websites
Avatar for Dean Hume deanohume
310
31k
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
30
2.9k
Docker and Python
Avatar for Tania Allard trallard
46
3.6k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.8k
BBQ
Avatar for Matthew Crist matthewcrist
89
9.8k
The Language of Interfaces
Avatar for Des Traynor destraynor
162
25k
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
16k
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
59
9.6k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1371
200k
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
9
850
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
667
120k

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology