Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Location analytics by MARC PLANAGUMÀ at Big Data Spain 2014

Location analytics by MARC PLANAGUMÀ at Big Data Spain 2014

While the implementation of analytic operations on distributed computing frameworks has been widely describing, enabling the computational core of a Big Data system with capabilities for supporting geospatial querying on data is yet a challenging issue. This session aims to target that specific aspect by reviewing how researchers at BDigital Technology Centre have designed and implemented a stack for advanced Machine Learning on Urban Data by providing a way to geoquery massive amounts of HDFS data from Spark processes without hindering the overall system performance.

Big Data Spain

November 25, 2014
Tweet

More Decks by Big Data Spain

Other Decks in Technology

Transcript

  1. Ciudad 2020 Exploratory lines and further work Joana Simoes, BDigital

    27/05/2014 Scaling up a in a world of geolocated data Marc Planagumà, BDigital Technology Centre
  2. Spatial data analytics Spatial analysis or spatial statistics includes any

    of the formal techniques which studies entities using their topological, geometric or geographic properties
  3. Spatial data analytics Geospatial data mining techniques Geospatial querying Spatial

    anomalies Geographically weighted regressions Self-organizing Maps Agent-based modeling
  4. Our Use Cases Customer activity tracking Where does people buy?

    What is the profile of the buyer? Traffic agencies Can we predict the traffic status? Can we predict the traffic incidences? Spatial data analytics
  5. Our Datasets Twitter (Point) Meteo (Polygon) Traffic status (Multi-Line-String) Traffic

    incidence (Multi-Point) Credit card ops (Multi-Point) Demographic (Point & Polygon) Shapefiles (Multi-Polygon) Spatial data analytics
  6. Old School Stack - Why Not? PostGIS Hadoop + GIS

    Tools ElasticSearch Kibana Spatial data analytics
  7. Hadoop Stack - The new Classic PostGIS Hadoop + GIS

    Tools ElasticSearch Kibana Spatial data analytics
  8. Complete Stack - Big Data GIS PostGIS Hadoop + GIS

    Tools ElasticSearch Kibana Spatial data analytics
  9. Do’s and Don’ts Geo Batch Near Real-Time Basic Geo Operations

    Workflow Composition Geo Streams Real-Time Advanced Geo Op. Unattended Workflow Spatial data analytics