Location analytics by MARC PLANAGUMÀ at Big Data Spain 2014

by Big Data Spain

Slide 1

Slide 1 text

SPATIAL DATA ANALYTICS MARC PLANAGUMÀ LEAD DATA ENGINEER AND RESEARCHER BDIGITAL

Slide 2

Slide 2 text

Ciudad 2020 Exploratory lines and further work Joana Simoes, BDigital 27/05/2014 Scaling up a in a world of geolocated data Marc Planagumà, BDigital Technology Centre

Slide 3

Slide 3 text

Our team

Slide 4

Slide 4 text

Our work

Slide 5

Slide 5 text

A world of geolocated data

Slide 6

Slide 6 text

Applications

Slide 7

Slide 7 text

No content

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

Spatial data analytics Spatial analysis or spatial statistics includes any of the formal techniques which studies entities using their topological, geometric or geographic properties

Slide 10

Slide 10 text

Spatial data analytics Basic Spatial Types Line Point Polygon * plus others

Slide 11

Slide 11 text

Spatial data analytics Geometries

Slide 12

Slide 12 text

Spatial data analytics Operations Contains Within

Slide 13

Slide 13 text

Spatial data analytics Operations Equals Disjoint

Slide 14

Slide 14 text

Spatial data analytics Operations Crosses Touches Overlaps

Slide 15

Slide 15 text

Spatial data analytics Operations Distance

Slide 16

Slide 16 text

Spatial data analytics Operations Union Difference

Slide 17

Slide 17 text

Spatial data analytics Operations Intersection Symmetric Diff

Slide 18

Slide 18 text

Spatial data analytics Complex operations Buffering Convex Hull

Slide 19

Slide 19 text

Spatial data analytics Complex operations Area

Slide 20

Slide 20 text

Spatial data analytics Geospatial data mining techniques Density-based clustering Hierarchy-based clustering

Slide 21

Slide 21 text

Spatial data analytics Geospatial data mining techniques Heatmaps

Slide 22

Slide 22 text

Spatial data analytics Geospatial data mining techniques Trajectory mining

Slide 23

Slide 23 text

Spatial data analytics Geospatial data mining techniques Geospatial querying Spatial anomalies Geographically weighted regressions Self-organizing Maps Agent-based modeling

Slide 24

Slide 24 text

Our Use Cases Customer activity tracking Where does people buy? What is the profile of the buyer? Traffic agencies Can we predict the traffic status? Can we predict the traffic incidences? Spatial data analytics

Slide 25

Slide 25 text

Our Datasets Twitter (Point) Meteo (Polygon) Traffic status (Multi-Line-String) Traffic incidence (Multi-Point) Credit card ops (Multi-Point) Demographic (Point & Polygon) Shapefiles (Multi-Polygon) Spatial data analytics

Slide 26

Slide 26 text

Our Tools Queries Clustering Heat maps Trajectory Anomaly detection Spatial data analytics

Slide 27

Slide 27 text

Our Stacks

Slide 28

Slide 28 text

Old School Stack - Why Not? PostGIS Hadoop + GIS Tools ElasticSearch Kibana Spatial data analytics

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

Hadoop Stack - The new Classic PostGIS Hadoop + GIS Tools ElasticSearch Kibana Spatial data analytics

Slide 31

Slide 31 text

No content

Slide 32

Slide 32 text

Complete Stack - Big Data GIS PostGIS Hadoop + GIS Tools ElasticSearch Kibana Spatial data analytics

Slide 33

Slide 33 text

No content

Slide 34

Slide 34 text

Do’s and Don’ts Geo Batch Near Real-Time Basic Geo Operations Workflow Composition Geo Streams Real-Time Advanced Geo Op. Unattended Workflow Spatial data analytics

Slide 1

Slide 1 text

Slide 2

Slide 2 text

Slide 3

Slide 3 text

Slide 4

Slide 4 text

Slide 5

Slide 5 text

Slide 6

Slide 6 text

Slide 7

Slide 7 text

Slide 8

Slide 8 text

Slide 9

Slide 9 text

Slide 10

Slide 10 text

Slide 11

Slide 11 text

Slide 12

Slide 12 text

Slide 13

Slide 13 text

Slide 14

Slide 14 text

Slide 15

Slide 15 text

Slide 16

Slide 16 text

Slide 17

Slide 17 text

Slide 18

Slide 18 text

Slide 19

Slide 19 text

Slide 20

Slide 20 text

Slide 21

Slide 21 text

Slide 22

Slide 22 text

Slide 23

Slide 23 text

Slide 24

Slide 24 text

Slide 25

Slide 25 text

Slide 26

Slide 26 text

Slide 27

Slide 27 text

Slide 28

Slide 28 text

Slide 29

Slide 29 text

Slide 30

Slide 30 text

Slide 31

Slide 31 text

Slide 32

Slide 32 text

Slide 33

Slide 33 text

Slide 34

Slide 34 text

Slide 35

Slide 35 text

Slide 36

Slide 36 text

Slide 37

Slide 37 text

Slide 38

Slide 38 text