Slide 1

Slide 1 text

Introduction to Data Stream Mining Albert Bifet March 2012

Slide 2

Slide 2 text

Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing

Slide 3

Slide 3 text

Motivation Memory unit Size Binary size kilobyte (kB/KB) 103 210 megabyte (MB) 106 220 gigabyte (GB) 109 230 terabyte (TB) 1012 240 petabyte (PB) 1015 250 exabyte (EB) 1018 260 zettabyte (ZB) 1021 270 yottabyte (YB) 1024 280 Data is growing

Slide 4

Slide 4 text

Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing

Slide 5

Slide 5 text

Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing

Slide 6

Slide 6 text

Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing

Slide 7

Slide 7 text

Streaming Data Big Data & Real Time

Slide 8

Slide 8 text

Big Data McKinsey Global Institute (MGI) Report on Big Data, 2011. Big data refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze.

Slide 9

Slide 9 text

Big Data McKinsey Global Institute (MGI) Report on Big Data, 2011. Big data refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze.

Slide 10

Slide 10 text

Methodology Sampling and distributed systems

Slide 11

Slide 11 text

Methodology Paolo Boldi Big Data does not need big machines, it needs big intelligence

Slide 12

Slide 12 text

Real time analytics We want to analyze what is happening now.

Slide 13

Slide 13 text

Real time analytics We want to analyze what is happening now.

Slide 14

Slide 14 text

Time and Memory Number 8 Wire Mentality Time and memory are the resource dimensions of the process.

Slide 15

Slide 15 text

Time and Memory Time and memory are the resource dimensions of the process.

Slide 16

Slide 16 text

Algorithms Classification, Regression, Clustering, Frequent Pattern Mining.

Slide 17

Slide 17 text

Applications sensor data: industry, cities telecomm data social networks: twitter, facebook, yahoo marketing: sales business Data may come from: humans, sensors, or machines.

Slide 18

Slide 18 text

Data Streams Big Data & Real Time