Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Event Detection

Marco Sero
October 19, 2012

Event Detection

This project is the thesis work for my bachelor degree at the Department of Computer Science of University of Turin.

Marco Sero

October 19, 2012
Tweet

More Decks by Marco Sero

Other Decks in Research

Transcript

  1. EVENT DETECTION A system to detect geo-tagged events in real-time

    through the analysis of social datas. Università degli Studi di Torino Department of Computer Science Graduate: Marco Sero Supervisor: Prof. Giancarlo Ruffo
  2. MOBILE SOCIAL NETWORKING •  Leading social networks such as Facebook

    and Twitter are used mainly by mobile •  There is a bunch of other social networks born only for mobile (Instagram, Foursquare, Path)
  3. GEOTAG •  Thanks to mobile, the main part of these

    datas is georeferenced with accurate GPS coordinate, the geotag •  Moreover, very often photos and tweets have one or more key-words, the #hashtag + HASHTAG
  4. PROJECT To join tweets and photos with the same hashtag

    and geographically close so as to detect social georeferenced events in real time
  5. THE CLUSTERING ALGORITHM •  Undefined Clustering •  Noise •  Cons:

    - no concurrency DBSCAN (Density-Based Spatial Clustering of Applications with Noise)
  6. •  MapReduce: programming paradigm to support concurrent and distributed computation

    •  Hadoop: framework to implement MapReduce applications MAP MAP MAP INPUT REDUCE   REDUCE   OUTPUT   (K, V) MAPREDUCE and HADOOP
  7. SIMULATION MAP MAP MAP MAP MAP REDUCE   REDUCE  

    MAP MAP #london2012 51, 0 #storm 40, -73 #storm 40, -73 #storm 40, -73 #london2012 51, 0 #london2012 51, 0 #london2012 51, 0 #storm 40, -73 #london2012 51, 0
  8. MAP function map(P, eps, MinPts) if P is unvisited then

    mark P as visited NeighborPts = regionQuery(P, eps) if sizeof(NeighborPts) < MinPts then do nothing else mark P as clusterized prepare the key create new cluster C C.neighborPoints = NeighborPts C.points = P emit(key, C) Creation of the new cluster Search neighborhood
  9. REDUCE function reduce(key, clusters, eps, MinPts) finalC is the final

    cluster for all C in clusters do finalC.points = finalC.points ∪ C.points for all P in C.neighborPoints do if P′ is not visited then mark P′ as visited NeighborPts′ = regionQuery(P′,eps) if sizeof(NeighborPts′) ≥ MinPts then NeighborPts = NeighborPts ∪ NeighborPts′ end if end if if P′ is not yet member of any cluster then add P′ to cluster finalC end if Clusters in input Neighborhood analysis for each cluster Cluster expansion Merge of points
  10. THE CHOICE OF THE DATABASE •  GIS (Geographic Information System)

    •  Speed •  Scalability •  Open source
  11. iOS APPLICATION •  View the events both on the map

    or on the list •  Scan social networks for each event •  Share the events