Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Distributed Systems

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Albert Bifet Albert Bifet
August 25, 2012
Research
300
1

Distributed Systems

Avatar for Albert Bifet

Albert Bifet

August 25, 2012

More Decks by Albert Bifet

See All by Albert Bifet
Frequent Pattern Mining
Avatar for Albert Bifet abifet
1
290
Regression
Avatar for Albert Bifet abifet
0
300
Evaluation
Avatar for Albert Bifet abifet
1
270
Stream Algorithmics
Avatar for Albert Bifet abifet
1
430
Introduction to Data Stream Mining
Avatar for Albert Bifet abifet
1
270
Clustering
Avatar for Albert Bifet abifet
2
340
Ensemble Methods
Avatar for Albert Bifet abifet
0
310
Classification
Avatar for Albert Bifet abifet
0
380
Concept Drift
Avatar for Albert Bifet abifet
0
440

Other Decks in Research

See All in Research
FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing
Avatar for SatAI.challenge satai
3
860
Apache Gravitinoで実現する Icebergカタログ統合とアクセスの一元化
Avatar for matsumooon matsumooon
0
290
RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent
Avatar for SatAI.challenge satai
2
300
衛星×エッジAI勉強会 衛星上におけるAI処理制約とそ取組について
Avatar for SatAI.challenge satai
4
560
第12回人と環境にやさしい交通をめざす全国大会／熊本都市圏「車1割削減、渋滞半減、公共交通2倍」をめざして
Avatar for Traffic Brain trafficbrain
0
110
Dual Quadric表現を用いた動的物体追跡とRGB-D・IMU制約の密結合によるオドメトリ推定
Avatar for Toyozo Shimada nanoshimarobot
0
410
SAKURAONE: An Open Ethernet-based AI HPC System And Its Observed Workload Dynamics in a Single-Tenant LLM Development Environment
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
1
340
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
300
羽田新ルート運用6年の検証
Avatar for マン点 1manken
0
160
東京大学工学部計数工学科、計数工学特別講義の説明資料
Avatar for KIKUCHI Shunsuke kikuzo
0
490
機械学習で作った ポケモン対戦bot で 遊ぼう！
Avatar for Yusuke Fukasawa fufufukakaka
0
280
(SIGQS17) Frasco-VS：フラグメントに基づく薬剤候補化合物選抜の量子アニーリングによる実現
Avatar for Keisuke Yanagisawa keisukeyanagisawa
PRO
0
110

Featured

See All Featured
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.5k
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
Avatar for Aleyda Solis aleyda
1
2.1k
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
7
36k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
56k
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
240
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
3
410
How to build an LLM SEO readiness audit: a practical framework
Avatar for Nick Samuel nmsamuel
1
780
How to Talk to Developers About Accessibility
Avatar for Jason CranfordTeague jct
2
230
Navigating the Design Leadership Dip - Product Design Week Design Leaders+ Conference 2024
Avatar for Andy Polaine apolaine
1
350
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
35k
Groundhog Day: Seeking Process in Gaming for Health
Avatar for Sebastian Deterding codingconduct
0
210
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
1
390

Transcript

  1. Distributed Streaming Albert Bifet May 2012

  2. COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics

    3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern Mining 10. Distributed Streaming

  3. Data Streams Big Data & Real Time

  4. Distributed Systems Hadoop, S4 and Storm

  5. Hadoop Hadoop

  6. Hadoop Hadoop architecture

  7. Apache Mahout Mahout: open source framework

  8. Pig Pig: Similar to SQL

  9. Pig A = LOAD ’data’ USING PigStorage() AS (f1:int, f2:int,

    f3:int); B = GROUP A BY f1; C = FOREACH B GENERATE COUNT ($0); DUMP C; Pig: Similar to SQL

  10. Apache S4 Apache S4

  11. Apache S4

  12. Storm Storm from Twitter

  13. Storm Stream, Spout, Bolt, Topology