OpenGeoData: What, Where and Why?

Lecture given to students of Spatial Information Science, Dublin Institute of Technology, on 23rd November 2012

Transcript

1. Open GeoData: Why, What and Where is it? Richard Cantwell Senior GIS Consultant / Technical Manager www.gamma.ie richard.cantwell@gamma.ie @ManAboutCouch
2. Cartography.. Spatial Data.. GIS.. all changing. www.axismaps.com/typographic.php
3. www.nuim.ie/staff/dpringle/qsms.shtml Early Computer mapping – Belfast, 1972
4. Computer mapping – Belfast, 40 years later
5. Google Maps: Turning the world upside down since 2005
6. Pre rendered tiles – Range of data sources AJAX (Asynchronous JavaScript and XML) Open API's - Mashups Rapid development – releases every 7-10 days Google Earth Google Maps - Key Innovations http://berglondon.com/projects/hat/
7. More Than A Map www.morethanamap.com
8. Restrictions: (there are many, these are just a few) Advertising – Google reserves the right to advertise on the map Access – APIs can only be accessed via a Google Map Content – No access to raw vector data Transaction Limits – 25,000 Map loads per day Derivative work – No copying, tracing or other modification Offline – Very limited offline use (Android phones only)
9. Open Knowledge: “A piece of content or data is open if you are free to use, reuse, and redistribute it - subject only, at most, to the requirement to attribute and share-alike.” www.opendefinition.org What is Open? http://flic.kr/p/7Aqgs5
10. New sources of GeoData http://www.flickr.com/photos/walkingsf/4672160490
11. Shining a Light... http://www.walkspace.org/namaland/
12. Open not always the default option http://www.oobrien.com/vis/bikes/
13. Dependencies – data or services can be 'switched off'
14. Local Authorities getting on board data.fingal.ie
15. Dublinked Dublinked.com
16. opendatahandbook.org • Transparency and democratic control • Participation • Self-empowerment • Improved or new private products and services • Innovation • Improved efficiency & effectiveness of government services • Impact measurement of policies • New knowledge from combined data sources and patterns in large data volumes
17. blog.datamarket.com A Private Sector View?
18. Vs www.creativecommons.org
19. Software / Data Licences
20. . A Legal Minefield? discovery.ac.uk/files/pdf/Licensing_Open_Data_A_Practical_Guide.pdf
21. Free (government) data isn't necessarily the answer www.slideshare.net/pmbatty/geodata-creationpast-present-and-future
22. No Data is Perfect, even expensive Commercial Data
23. No Data is Perfect, even expensive Commercial Data
24. Bad POI Data
28. The future of commercial online mapping? Logorama: vimeo.com/10149605
29. The future of commercial online mapping? www.citymaps.com
30. tools.geofabrik.de/mc
31. tools.geofabrik.de/mc
32. Global Scale Commercial GeoData Suppliers
33. Acquisitions Completed Late 2007 / Early 2008
34. € 8,600,000,000 € 5,700,000,000 € 2,900,000,000 How Much?
35. “Database Creation and Delivery Costs” Q1 2008: $115,423,000 Annualised: $461,692,000 From last earnings report before Nokia acquisition
36. 1,100 Staff 6,000 Contractors http://read.bi/MrAi0j
37. € 25,000,000 Annual Report 2010 Annual Running Cost
38. £ 34,918 http://www.osmfoundation.org/wiki/Finances/Income_2011 (Income: £ 58,869) Expenses 2011
39. ITO OpenStreetMap Year of Edits Video - 2011 https://vimeo.com/48984270
43. OpenStreetMap www.openstreetmap.org
45. Large Community: 600,000 Users. Rapid Growth: 75% in 2011 www.beyonav.com/openstreetmaps-growth-accelerates
46. www.itoworld.com/map/main
47. www.itoworld.com/map/main
48. www.itoworld.com/map/main
49. www.itoworld.com/map/main
50. www.itoworld.com/map/main
51. SRTM www.opencyclemap.org
52. maps.openstreetmap.ie
53. CORINE Landcover maps.openstreetmap.ie/corineimport.html
54. maps.openstreetmap.ie
55. Web mapping: Gaining Functionality map.project-osrm.org
56. Raw Vector Data available
58. maps.stamen.com/watercolor
59. Tile Data maps.stamen.com
60. izeize.com/openmaps
61. Recent Announcements of Switches to and Support for OSM
62. * SLA’s available from 3rd parties (€€). Self-hosting is cheap but can be complex. OpenStreetMap • API’s aimed at data editors • Limited API functionality • No ‘Service Level Agreements’* • ‘Viral’ nature of data licence • Focus on map data • ‘Warm Geography’ • Instant data updates, Sporadic • ‘Depth’ Issues (coverage, completeness) • Metadata Other Data Providers: • API’s aimed at data consumers • Extensive API functionality • SLA’s available (but €€) • Derived data issues • Focus on services • ‘Cold Geography’ • Moderated update process, Consistent • ‘Width’ issues (limited featureset) • Pricing
63. Formats and Metadata are important.. but.. Vs A 'do-ocracy': “Build it and get out of the way” Top-down approach.
64. opendatacommons.org/licenses/odbl/summary
65. Privacy / Data Protection petewarden.github.com/iPhoneTracker
66. GeoData Sources (some more open than others)
67. maps.osi.ie/publicviewer
68. www.npws.ie/mapsanddata
69. gis.epa.ie/betazone/envision/
70. airomaps.nuim.ie/census2011
71. www.dcenr.gov.ie/Spatial+Dat GSI / DCENR: An Irish Open Data Pioneer?
72. www.dcenr.gov.ie/Spatial+Dat GSI / DCENR: An Irish Open Data Pioneer?
73. www.isde.ie The Irish Spatial Data Exchange
74. DubLinked dublinked.com
75. Spatial is Popular
76. opendata.ie A wider movement..
77. SRTM srtm.csi.cgiar.org
78. Continuous Variance: Surface
79. GeoNames www.geonames.org
80. Geonames www.geonames.org
81. GeoNames Visualised www.datapointed.net/2011/01/happy-new-year
82. Landsat http://zulu.ssc.nasa.gov/mrsid/mrsid.p l
83. Entire Planet downloadable (~500GB uncompressed) planet.openstreetmap.org
84. Entire Planet downloadable (~500GB uncompressed) planet.openstreetmap.org
85. Processed data downloads & services www.geofabrik.de
86. download.geofabrik.de
87. download.geofabrik.de Including pre-configured Shapefiles (reduced featureset)
88. Cartography.. Spatial Data.. GIS.. all changing. www.axismaps.com/typographic.php
89. Cartography.. Spatial Data.. GIS.. all changing. www.axismaps.com/typographic.php
90. Cartography.. Spatial Data.. GIS.. all changing. www.axismaps.com/typographic.php
92. www.gamma.ie
93. www.autoaddress.ie Irish Geocoding
94. Using OSM Data
95. Static Data APIs: xapi / OverPass overpass-api.de
97. Tile Data
98. Tile Data Pyramid tile.openstreetmap.org/0/0/0.png tile.openstreetmap.org/10/494/331.png tile.openstreetmap.org/18/126521/84975.png
99. OpenStreetMap – Tile Usage wiki.openstreetmap.org/wiki/Tile_Disk_Usage OSM does NOT pre-render every tile. Pre-rendering all tiles would use around 54,000 GB of storage. The majority of tiles are never viewed. In fact just 1.79% have ever been viewed. This is because the majority of tiles are at zoom level 18 and the vast majority of those contain nothing of interest (the sea, for example) By following an on-the-fly rendering approach we can avoid rendering these tiles unnecessarily. The tile view count column shows how many tiles have been produced on the OSM Tile server. Tile server disk usage: 1,272 GB used. (6 Jan 2012). (z0 to z15: 252 GB, z16 to z18: 1,020 GB)
100. Edit Store Render Consume Store Analyse
101. Using OSM data in GIS
104. Daft.ie Switch to OSM – March 2012 www.switch2osm.org
105. www.mapbox.com/tilemill
106. www.mapbox.com/tilemill
107. www.mapbox.com/tilemill
108. Contributing to OSM
109. Contributing to OpenStreetMap Rule 1: Respect Copyright
110. 30cm Imagery available for tracing 2.7m RMSE
111. The impact of High Resolution imagery
112. wiki.openstreetmap.org/wiki/Bing
113. wiki.openstreetmap.org/wiki/National_Library_of_Scotland
114. wiki.openstreetmap.org/wiki/Beginners%27_guide Contributing to OpenStreetMap
115. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide
116. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide
117. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide
118. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide
119. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide
120. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide
121. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide
122. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide
123. Not just Bing...
124. walking-papers.org GPS Mapping – on Paper
125. pushpinosm.org Mobile Apps – PushPinOSM - iOS
126. code.google.com/p/osmeditor4and Mobile Apps – Vespucci - Android
132. Tracking New Users resultmaps.neis-one.org/newestosm.php
133. “Many eyes make all bugs shallow” openstreetbugs.schokokeks.org/
134. Spotting Errors tools.geofabrik.de/osm i
135. Spotting Errors keepright.ipax.at
136. Contributing to OpenStreetMap Rule 1: Respect Copyright
137. OSM Wiki: wiki.openstreetmap.org OSM Help Forums: help.openstreetmap.org OSM-F Blog: blog.osmfoundation.org OpenGeoData Blog (OSM News): opengeodata.org Contacting Irish Mappers: Mailing List: talk-ie@openstreetmap.org IRC: irc://irc.oftc.net #osm-ie or #osm (Twitter: @osm_ie) Contacting OSM
138. Thank You Richard Cantwell Senior GIS Consultant / Technical Manager www.gamma.ie richard.cantwell@gamma.ie @ManAboutCouch