Open GeoData:
Why, What and
Where is it?
Richard Cantwell
Senior GIS Consultant /
Technical Manager
www.gamma.ie
[email protected]
@ManAboutCouch
Slide 2
Slide 2 text
Cartography.. Spatial Data.. GIS.. all changing.
www.axismaps.com/typographic.php
Slide 3
Slide 3 text
www.nuim.ie/staff/dpringle/qsms.shtml
Early Computer mapping – Belfast, 1972
Slide 4
Slide 4 text
Computer mapping – Belfast, 40 years later
Slide 5
Slide 5 text
Google Maps: Turning the world upside down since 2005
Slide 6
Slide 6 text
Pre rendered tiles – Range of data sources
AJAX (Asynchronous JavaScript and XML)
Open API's - Mashups
Rapid development – releases every 7-10
days
Google Earth
Google Maps - Key Innovations
http://berglondon.com/projects/hat/
Slide 7
Slide 7 text
More Than A Map
www.morethanamap.com
Slide 8
Slide 8 text
Restrictions: (there are many, these are just a few)
Advertising – Google reserves the right to advertise on the map
Access – APIs can only be accessed via a Google Map
Content – No access to raw vector data
Transaction Limits – 25,000 Map loads per day
Derivative work – No copying, tracing or other modification
Offline – Very limited offline use (Android phones only)
Slide 9
Slide 9 text
Open Knowledge:
“A piece of content or data is open if you are free to use, reuse, and redistribute it
- subject only, at most, to the requirement to attribute and share-alike.”
www.opendefinition.org
What is Open?
http://flic.kr/p/7Aqgs5
Slide 10
Slide 10 text
New sources of GeoData
http://www.flickr.com/photos/walkingsf/4672160490
Slide 11
Slide 11 text
Shining a Light...
http://www.walkspace.org/namaland/
Slide 12
Slide 12 text
Open not always the default option
http://www.oobrien.com/vis/bikes/
Slide 13
Slide 13 text
Dependencies – data or services can be 'switched off'
Slide 14
Slide 14 text
Local Authorities getting on board
data.fingal.ie
Slide 15
Slide 15 text
Dublinked
Dublinked.com
Slide 16
Slide 16 text
opendatahandbook.org
• Transparency and democratic control
• Participation
• Self-empowerment
• Improved or new private products and services
• Innovation
• Improved efficiency & effectiveness of government services
• Impact measurement of policies
• New knowledge from combined data sources and patterns in
large data volumes
Slide 17
Slide 17 text
blog.datamarket.com
A Private Sector View?
Slide 18
Slide 18 text
Vs
www.creativecommons.org
Slide 19
Slide 19 text
Software / Data Licences
Slide 20
Slide 20 text
.
A Legal Minefield?
discovery.ac.uk/files/pdf/Licensing_Open_Data_A_Practical_Guide.pdf
Slide 21
Slide 21 text
Free (government) data isn't necessarily the answer
www.slideshare.net/pmbatty/geodata-creationpast-present-and-future
Slide 22
Slide 22 text
No Data is Perfect, even expensive Commercial Data
Slide 23
Slide 23 text
No Data is Perfect, even expensive Commercial Data
Slide 24
Slide 24 text
Bad POI Data
Slide 25
Slide 25 text
No content
Slide 26
Slide 26 text
No content
Slide 27
Slide 27 text
No content
Slide 28
Slide 28 text
The future of commercial online mapping?
Logorama: vimeo.com/10149605
Slide 29
Slide 29 text
The future of commercial online mapping?
www.citymaps.com
Slide 30
Slide 30 text
tools.geofabrik.de/mc
Slide 31
Slide 31 text
tools.geofabrik.de/mc
Slide 32
Slide 32 text
Global Scale Commercial GeoData Suppliers
Slide 33
Slide 33 text
Acquisitions Completed Late 2007 / Early 2008
Slide 34
Slide 34 text
€ 8,600,000,000
€ 5,700,000,000
€ 2,900,000,000
How Much?
Slide 35
Slide 35 text
“Database Creation and Delivery Costs”
Q1 2008: $115,423,000
Annualised: $461,692,000
From last earnings report before Nokia acquisition
Web mapping: Gaining Functionality
map.project-osrm.org
Slide 56
Slide 56 text
Raw Vector Data available
Slide 57
Slide 57 text
No content
Slide 58
Slide 58 text
maps.stamen.com/watercolor
Slide 59
Slide 59 text
Tile Data
maps.stamen.com
Slide 60
Slide 60 text
izeize.com/openmaps
Slide 61
Slide 61 text
Recent Announcements of Switches to and Support for OSM
Slide 62
Slide 62 text
* SLA’s available from 3rd parties (€€). Self-hosting is cheap but can be complex.
OpenStreetMap
• API’s aimed at data editors
• Limited API functionality
• No ‘Service Level Agreements’*
• ‘Viral’ nature of data licence
• Focus on map data
• ‘Warm Geography’
• Instant data updates, Sporadic
• ‘Depth’ Issues (coverage, completeness)
• Metadata
Other Data Providers:
• API’s aimed at data consumers
• Extensive API functionality
• SLA’s available (but €€)
• Derived data issues
• Focus on services
• ‘Cold Geography’
• Moderated update process, Consistent
• ‘Width’ issues (limited featureset)
• Pricing
Slide 63
Slide 63 text
Formats and Metadata are important.. but..
Vs
A 'do-ocracy':
“Build it and get out of the way”
Top-down approach.
Slide 64
Slide 64 text
opendatacommons.org/licenses/odbl/summary
Slide 65
Slide 65 text
Privacy / Data Protection
petewarden.github.com/iPhoneTracker
Slide 66
Slide 66 text
GeoData Sources
(some more open than others)
Slide 67
Slide 67 text
maps.osi.ie/publicviewer
Slide 68
Slide 68 text
www.npws.ie/mapsanddata
Slide 69
Slide 69 text
gis.epa.ie/betazone/envision/
Slide 70
Slide 70 text
airomaps.nuim.ie/census2011
Slide 71
Slide 71 text
www.dcenr.gov.ie/Spatial+Dat
GSI / DCENR: An Irish Open Data Pioneer?
Slide 72
Slide 72 text
www.dcenr.gov.ie/Spatial+Dat
GSI / DCENR: An Irish Open Data Pioneer?
Processed data downloads & services
www.geofabrik.de
Slide 86
Slide 86 text
download.geofabrik.de
Slide 87
Slide 87 text
download.geofabrik.de
Including pre-configured Shapefiles (reduced featureset)
Slide 88
Slide 88 text
Cartography.. Spatial Data.. GIS.. all changing.
www.axismaps.com/typographic.php
Slide 89
Slide 89 text
Cartography.. Spatial Data.. GIS.. all changing.
www.axismaps.com/typographic.php
Slide 90
Slide 90 text
Cartography.. Spatial Data.. GIS.. all changing.
www.axismaps.com/typographic.php
Slide 91
Slide 91 text
No content
Slide 92
Slide 92 text
www.gamma.ie
Slide 93
Slide 93 text
www.autoaddress.ie
Irish Geocoding
Slide 94
Slide 94 text
Using OSM Data
Slide 95
Slide 95 text
Static Data APIs: xapi / OverPass
overpass-api.de
Slide 96
Slide 96 text
No content
Slide 97
Slide 97 text
Tile Data
Slide 98
Slide 98 text
Tile Data Pyramid
tile.openstreetmap.org/0/0/0.png
tile.openstreetmap.org/10/494/331.png
tile.openstreetmap.org/18/126521/84975.png
Slide 99
Slide 99 text
OpenStreetMap – Tile Usage
wiki.openstreetmap.org/wiki/Tile_Disk_Usage
OSM does NOT pre-render every tile.
Pre-rendering all tiles would use around 54,000 GB of
storage.
The majority of tiles are never viewed. In fact just
1.79% have ever been viewed.
This is because the majority of tiles are at zoom
level 18 and the vast majority of those contain nothing
of interest (the sea, for example)
By following an on-the-fly rendering approach we can
avoid rendering these tiles unnecessarily.
The tile view count column shows how many tiles have
been produced on the OSM Tile server.
Tile server disk usage: 1,272 GB used. (6 Jan 2012).
(z0 to z15: 252 GB, z16 to z18: 1,020 GB)
Slide 100
Slide 100 text
Edit Store Render Consume
Store Analyse
Slide 101
Slide 101 text
Using OSM data in GIS
Slide 102
Slide 102 text
No content
Slide 103
Slide 103 text
No content
Slide 104
Slide 104 text
Daft.ie Switch to OSM – March 2012
www.switch2osm.org
Slide 105
Slide 105 text
www.mapbox.com/tilemill
Slide 106
Slide 106 text
www.mapbox.com/tilemill
Slide 107
Slide 107 text
www.mapbox.com/tilemill
Slide 108
Slide 108 text
Contributing to OSM
Slide 109
Slide 109 text
Contributing to OpenStreetMap
Rule 1: Respect Copyright