An Introduction to Spatial Data: Sources & Methods

Slide 1

Slide 1 text

An Introduction to Spatial Data: Sources and Methods Richard Cantwell Senior GIS Consultant / Technical Manager www.gamma.ie [email protected] @ManAboutCouch

Slide 2

Slide 2 text

www.gamma.ie

Slide 3

Slide 3 text

Mercator, World Map, 1569

Slide 4

Slide 4 text

Griffith Valuation, 1850-1858

Slide 5

Slide 5 text

www.nuim.ie/staff/dpringle/qsms.shtml Early Computer mapping – Belfast 1972

Slide 6

Slide 6 text

Computer mapping – Belfast, 40 years later

Slide 7

Slide 7 text

Google Maps: Turning the world upside down since 2005

Slide 8

Slide 8 text

Pre rendered tiles – Range of data sources AJAX (Asynchronous JavaScript and XML) Open API's - Mashups Rapid development – releases every 7-10 days Google Earth Google Maps - Key Innovations http://berglondon.com/projects/hat/

Slide 9

Slide 9 text

More Than A Map www.morethanamap.com

Slide 10

Slide 10 text

“A piece of content or data is Open if you are free to use, reuse, and redistribute it - subject only, at most, to the requirement to attribute and share-alike.” www.opendefinition.org http://flic.kr/p/7Aqgs5

Slide 11

Slide 11 text

OpenStreetMap www.openstreetmap.org

Slide 12

Slide 12 text

New sources of GeoData http://www.flickr.com/photos/walkingsf/4672160490

Slide 13

Slide 13 text

Shining a Light... http://www.walkspace.org/namaland/

Slide 14

Slide 14 text

Open not always the default option http://www.oobrien.com/vis/bikes/

Slide 15

Slide 15 text

Dependencies – data or services can be 'switched off'

Slide 16

Slide 16 text

Local Authorities getting on board data.fingal.ie

Slide 17

Slide 17 text

Passive Crowdsourcing

Slide 18

Slide 18 text

Passive Crowdsourcing opensignalmaps.com

Slide 19

Slide 19 text

tools.geofabrik.de/mc

Slide 20

Slide 20 text

tools.geofabrik.de/mc

Slide 21

Slide 21 text

No content

Slide 22

Slide 22 text

No content

Slide 23

Slide 23 text

Why Maps?

Slide 24

Slide 24 text

Why Maps?

Slide 25

Slide 25 text

No content

Slide 26

Slide 26 text

No content

Slide 27

Slide 27 text

John Snow's 'Cholera Map' from 1854 www.TheGhostMap.com

Slide 28

Slide 28 text

No content

Slide 29

Slide 29 text

Layering Data to gain insights.

Slide 30

Slide 30 text

What’s Special about Spatial?

Slide 31

Slide 31 text

What’s Special about Spatial? www.blanz.net/geo13.html

Slide 32

Slide 32 text

Spatial data – data that is 'located in space'

Slide 33

Slide 33 text

Represent the curved earth on a flat screen or paper: Projections

Slide 34

Slide 34 text

Projections http://xkcd.com/977

Slide 35

Slide 35 text

Projections

Slide 36

Slide 36 text

Vector Data: Point

Slide 37

Slide 37 text

Vector Data: Line

Slide 38

Slide 38 text

Vector Data: Region

Slide 39

Slide 39 text

Raster data.

Slide 40

Slide 40 text

Tile Data: .../{z}/{x}/{y}.png mike.teczno.com

Slide 41

Slide 41 text

Tile Data Pyramid tile.openstreetmap.org/0/0/0.png tile.openstreetmap.org/10/494/331.png tile.openstreetmap.org/18/126521/84975.png

Slide 42

Slide 42 text

GeoCoded Address data www.autoaddress.ie

Slide 43

Slide 43 text

GeoCoded Address data www.autoaddress.ie

Slide 44

Slide 44 text

Issues particular to Spatial Data

Slide 45

Slide 45 text

Unintentional errors Intentional errors Projection issues Data Classification Scale Generalisation Interpretation Modifiable Areal Unit Problem (MAUP)

Slide 46

Slide 46 text

An Unintentional Error

Slide 47

Slide 47 text

A more recent example

Slide 48

Slide 48 text

Bad POI Data

Slide 49

Slide 49 text

Common data creation errors Overshoot Undershoot Pseudonode Dangling Node Missing Label Point Missing Node Polygon Label Point

Slide 50

Slide 50 text

The Map. The reality. An Intentional Error

Slide 51

Slide 51 text

Projection issues: Offset Imagery

Slide 52

Slide 52 text

Classifying Data: here be dragons.. colorbrewer2.org

Slide 53

Slide 53 text

No content

Slide 54

Slide 54 text

No content

Slide 55

Slide 55 text

No content

Slide 56

Slide 56 text

Why are these bastards lying to me

Slide 57

Slide 57 text

The Modifiable Areal Unit Problem

Slide 58

Slide 58 text

Tobler’s First Law of Geography: "Everything is related to everything else.. But near things are more related than distant things."

Slide 59

Slide 59 text

No content

Slide 60

Slide 60 text

No content

Slide 61

Slide 61 text

A ‘typical’ project

Slide 62

Slide 62 text

Deprivation Index, Northside Dublin, 2006

Slide 63

Slide 63 text

Deprivation Index, Northside Dublin, 2006

Slide 64

Slide 64 text

Residential Addresses, GeoDirectory, 2010

Slide 65

Slide 65 text

Combining Data

Slide 66

Slide 66 text

Geocoded Client Listing

Slide 67

Slide 67 text

GeoCoding www.autoaddress.ie

Slide 68

Slide 68 text

Geocoded Client Listing

Slide 69

Slide 69 text

Client Listing combined with GeoDirectory

Slide 70

Slide 70 text

Geocoded & Classified Client Listing

Slide 71

Slide 71 text

Market Analysis

Slide 72

Slide 72 text

Market Analysis - Mapping

Slide 73

Slide 73 text

Where to get Open GeoData

Slide 74

Slide 74 text

OSi Data http://maps.osi.ie/publicviewer/

Slide 75

Slide 75 text

Entire Planet downloadable (~500GB uncompressed) planet.openstreetmap.org

Slide 76

Slide 76 text

Processed data downloads & services www.geofabrik.de

Slide 77

Slide 77 text

download.geofabrik.de Including pre-configured Shapefiles (reduced featureset)

Slide 78

Slide 78 text

No content

Slide 79

Slide 79 text

SRTM http://srtm.csi.cgiar.org/

Slide 80

Slide 80 text

GeoNames http://www.geonames.org/

Slide 81

Slide 81 text

Geonames http://www.geonames.org/

Slide 82

Slide 82 text

GeoNames Visualised http://www.datapointed.net/2011/01/happy-new-year/

Slide 83

Slide 83 text

Landsat http://zulu.ssc.nasa.gov/mrsid/mrsid.pl

Slide 84

Slide 84 text

DubLinked http://www.dublinked.com

Slide 85

Slide 85 text

Spatial data is popular http://www.dublinked.com

Slide 86

Slide 86 text

www.npws.ie/mapsanddata

Slide 87

Slide 87 text

gis.epa.ie/betazone/envision/

Slide 88

Slide 88 text

airomaps.nuim.ie/census2011

Slide 89

Slide 89 text

www.dcenr.gov.ie/Spatial+Data GSI / DCENR: An Irish Open Data Pioneer?

Slide 90

Slide 90 text

www.dcenr.gov.ie/Spatial+Data GSI / DCENR: An Irish Open Data Pioneer?

Slide 91

Slide 91 text

www.isde.ie The Irish Spatial Data Exchange

Slide 92

Slide 92 text

www.irlogi.ie The Irish Organisation for Geographic Information (IRLOGI)

Slide 93

Slide 93 text

How to Use Open GeoData

Slide 94

Slide 94 text

Commercial Software www.mapinfo.com

Slide 95

Slide 95 text

Open Source Software www.osgeo.org

Slide 96

Slide 96 text

Open Source Software www.osgeo.org

Slide 97

Slide 97 text

Edit Store Render Consume Store Analyse

Slide 98

Slide 98 text

WFS / WMS / WCS http://www.opengeospatial.org/standards

Slide 99

Slide 99 text

API -> GeoJSON

Slide 100

Slide 100 text

Extract Raw Data – Map View overpass-turbo.eu

Slide 101

Slide 101 text

Extract Raw Data – Data View overpass-turbo.eu

Slide 102

Slide 102 text

Extract Raw Data – Embedded in a map

on a web page OpenLayers & OSM Overpass API

Slide 103

Slide 103 text

www.mapbox.com/tilemill Tilemill

Slide 104

Slide 104 text

No content

Slide 105

Slide 105 text

www.mapbox.com/tilemill

Slide 106

Slide 106 text

www.switch2osm.org

Slide 107

Slide 107 text

maps.stamen.com/watercolor

Slide 108

Slide 108 text

No content

Slide 109

Slide 109 text

Why Open GeoData?

Slide 110

Slide 110 text

Vs www.creativecommons.org Comparing Closed and Open GeoData

Slide 111

Slide 111 text

The future of commercial online mapping? Logorama: vimeo.com/10149605

Slide 112

Slide 112 text

www.citymaps.com The future of commercial online mapping?

Slide 113

Slide 113 text

maps.google.ie The future of commercial online mapping?

Slide 114

Slide 114 text

VGI: OpenStreetMap • Limited to what is ‘visible’ • API’s limited, aimed at data editors • ‘Viral’ nature of data licence • Focus on map data • ‘Warm Geography’ • Aims to be of Public Interest • Instant data updates, Sporadic • ‘Depth’ Issues (coverage, completeness) • Weak Metadata / Standards Commercial GeoData Providers • Wide source of inputs • API’s extensive, aimed at data consumers • Derived data issues • Focus on services • ‘Cold Geography’ • Aims to be Authoritive • Moderated update process, Consistent • ‘Width’ issues (limited featureset) • Expensive

Slide 115

Slide 115 text

Contributing to OpenStreetMap

Slide 116

Slide 116 text

Contributing to OpenStreetMap Rule 1: Respect Copyright

Slide 117

Slide 117 text

No content

Slide 118

Slide 118 text

wiki.openstreetmap.org/wiki/Bing

Slide 119

Slide 119 text

The impact of High Resolution imagery

Slide 120