Pro Yearly is on sale from $80 to $50! »

OpenGeoData: What, Where and Why?

OpenGeoData: What, Where and Why?

Lecture given to students of Spatial Information Science, Dublin Institute of Technology, on 23rd November 2012

68774527ffe627892f2164eafe3339a1?s=128

Richard Cantwell

December 01, 2012
Tweet

Transcript

  1. Open GeoData: Why, What and Where is it? Richard Cantwell

    Senior GIS Consultant / Technical Manager www.gamma.ie richard.cantwell@gamma.ie @ManAboutCouch
  2. Cartography.. Spatial Data.. GIS.. all changing. www.axismaps.com/typographic.php

  3. www.nuim.ie/staff/dpringle/qsms.shtml Early Computer mapping – Belfast, 1972

  4. Computer mapping – Belfast, 40 years later

  5. Google Maps: Turning the world upside down since 2005

  6. Pre rendered tiles – Range of data sources AJAX (Asynchronous

    JavaScript and XML) Open API's - Mashups Rapid development – releases every 7-10 days Google Earth Google Maps - Key Innovations http://berglondon.com/projects/hat/
  7. More Than A Map www.morethanamap.com

  8. Restrictions: (there are many, these are just a few) Advertising

    – Google reserves the right to advertise on the map Access – APIs can only be accessed via a Google Map Content – No access to raw vector data Transaction Limits – 25,000 Map loads per day Derivative work – No copying, tracing or other modification Offline – Very limited offline use (Android phones only)
  9. Open Knowledge: “A piece of content or data is open

    if you are free to use, reuse, and redistribute it - subject only, at most, to the requirement to attribute and share-alike.” www.opendefinition.org What is Open? http://flic.kr/p/7Aqgs5
  10. New sources of GeoData http://www.flickr.com/photos/walkingsf/4672160490

  11. Shining a Light... http://www.walkspace.org/namaland/

  12. Open not always the default option http://www.oobrien.com/vis/bikes/

  13. Dependencies – data or services can be 'switched off'

  14. Local Authorities getting on board data.fingal.ie

  15. Dublinked Dublinked.com

  16. opendatahandbook.org • Transparency and democratic control • Participation • Self-empowerment

    • Improved or new private products and services • Innovation • Improved efficiency & effectiveness of government services • Impact measurement of policies • New knowledge from combined data sources and patterns in large data volumes
  17. blog.datamarket.com A Private Sector View?

  18. Vs www.creativecommons.org

  19. Software / Data Licences

  20. . A Legal Minefield? discovery.ac.uk/files/pdf/Licensing_Open_Data_A_Practical_Guide.pdf

  21. Free (government) data isn't necessarily the answer www.slideshare.net/pmbatty/geodata-creationpast-present-and-future

  22. No Data is Perfect, even expensive Commercial Data

  23. No Data is Perfect, even expensive Commercial Data

  24. Bad POI Data

  25. None
  26. None
  27. None
  28. The future of commercial online mapping? Logorama: vimeo.com/10149605

  29. The future of commercial online mapping? www.citymaps.com

  30. tools.geofabrik.de/mc

  31. tools.geofabrik.de/mc

  32. Global Scale Commercial GeoData Suppliers

  33. Acquisitions Completed Late 2007 / Early 2008

  34. € 8,600,000,000 € 5,700,000,000 € 2,900,000,000 How Much?

  35. “Database Creation and Delivery Costs” Q1 2008: $115,423,000 Annualised: $461,692,000

    From last earnings report before Nokia acquisition
  36. 1,100 Staff 6,000 Contractors http://read.bi/MrAi0j

  37. € 25,000,000 Annual Report 2010 Annual Running Cost

  38. £ 34,918 http://www.osmfoundation.org/wiki/Finances/Income_2011 (Income: £ 58,869) Expenses 2011

  39. ITO OpenStreetMap Year of Edits Video - 2011 https://vimeo.com/48984270

  40. None
  41. None
  42. None
  43. OpenStreetMap www.openstreetmap.org

  44. None
  45. Large Community: 600,000 Users. Rapid Growth: 75% in 2011 www.beyonav.com/openstreetmaps-growth-accelerates

  46. www.itoworld.com/map/main

  47. www.itoworld.com/map/main

  48. www.itoworld.com/map/main

  49. www.itoworld.com/map/main

  50. www.itoworld.com/map/main

  51. SRTM www.opencyclemap.org

  52. maps.openstreetmap.ie

  53. CORINE Landcover maps.openstreetmap.ie/corineimport.html

  54. maps.openstreetmap.ie

  55. Web mapping: Gaining Functionality map.project-osrm.org

  56. Raw Vector Data available

  57. None
  58. maps.stamen.com/watercolor

  59. Tile Data maps.stamen.com

  60. izeize.com/openmaps

  61. Recent Announcements of Switches to and Support for OSM

  62. * SLA’s available from 3rd parties (€€). Self-hosting is cheap

    but can be complex. OpenStreetMap • API’s aimed at data editors • Limited API functionality • No ‘Service Level Agreements’* • ‘Viral’ nature of data licence • Focus on map data • ‘Warm Geography’ • Instant data updates, Sporadic • ‘Depth’ Issues (coverage, completeness) • Metadata Other Data Providers: • API’s aimed at data consumers • Extensive API functionality • SLA’s available (but €€) • Derived data issues • Focus on services • ‘Cold Geography’ • Moderated update process, Consistent • ‘Width’ issues (limited featureset) • Pricing
  63. Formats and Metadata are important.. but.. Vs A 'do-ocracy': “Build

    it and get out of the way” Top-down approach.
  64. opendatacommons.org/licenses/odbl/summary

  65. Privacy / Data Protection petewarden.github.com/iPhoneTracker

  66. GeoData Sources (some more open than others)

  67. maps.osi.ie/publicviewer

  68. www.npws.ie/mapsanddata

  69. gis.epa.ie/betazone/envision/

  70. airomaps.nuim.ie/census2011

  71. www.dcenr.gov.ie/Spatial+Dat GSI / DCENR: An Irish Open Data Pioneer?

  72. www.dcenr.gov.ie/Spatial+Dat GSI / DCENR: An Irish Open Data Pioneer?

  73. www.isde.ie The Irish Spatial Data Exchange

  74. DubLinked dublinked.com

  75. Spatial is Popular

  76. opendata.ie A wider movement..

  77. SRTM srtm.csi.cgiar.org

  78. Continuous Variance: Surface

  79. GeoNames www.geonames.org

  80. Geonames www.geonames.org

  81. GeoNames Visualised www.datapointed.net/2011/01/happy-new-year

  82. Landsat http://zulu.ssc.nasa.gov/mrsid/mrsid.p l

  83. Entire Planet downloadable (~500GB uncompressed) planet.openstreetmap.org

  84. Entire Planet downloadable (~500GB uncompressed) planet.openstreetmap.org

  85. Processed data downloads & services www.geofabrik.de

  86. download.geofabrik.de

  87. download.geofabrik.de Including pre-configured Shapefiles (reduced featureset)

  88. Cartography.. Spatial Data.. GIS.. all changing. www.axismaps.com/typographic.php

  89. Cartography.. Spatial Data.. GIS.. all changing. www.axismaps.com/typographic.php

  90. Cartography.. Spatial Data.. GIS.. all changing. www.axismaps.com/typographic.php

  91. None
  92. www.gamma.ie

  93. www.autoaddress.ie Irish Geocoding

  94. Using OSM Data

  95. Static Data APIs: xapi / OverPass overpass-api.de

  96. None
  97. Tile Data

  98. Tile Data Pyramid tile.openstreetmap.org/0/0/0.png tile.openstreetmap.org/10/494/331.png tile.openstreetmap.org/18/126521/84975.png

  99. OpenStreetMap – Tile Usage wiki.openstreetmap.org/wiki/Tile_Disk_Usage OSM does NOT pre-render every

    tile. Pre-rendering all tiles would use around 54,000 GB of storage. The majority of tiles are never viewed. In fact just 1.79% have ever been viewed. This is because the majority of tiles are at zoom level 18 and the vast majority of those contain nothing of interest (the sea, for example) By following an on-the-fly rendering approach we can avoid rendering these tiles unnecessarily. The tile view count column shows how many tiles have been produced on the OSM Tile server. Tile server disk usage: 1,272 GB used. (6 Jan 2012). (z0 to z15: 252 GB, z16 to z18: 1,020 GB)
  100. Edit Store Render Consume Store Analyse

  101. Using OSM data in GIS

  102. None
  103. None
  104. Daft.ie Switch to OSM – March 2012 www.switch2osm.org

  105. www.mapbox.com/tilemill

  106. www.mapbox.com/tilemill

  107. www.mapbox.com/tilemill

  108. Contributing to OSM

  109. Contributing to OpenStreetMap Rule 1: Respect Copyright

  110. 30cm Imagery available for tracing 2.7m RMSE

  111. The impact of High Resolution imagery

  112. wiki.openstreetmap.org/wiki/Bing

  113. wiki.openstreetmap.org/wiki/National_Library_of_Scotland

  114. wiki.openstreetmap.org/wiki/Beginners%27_guide Contributing to OpenStreetMap

  115. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide

  116. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide

  117. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide

  118. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide

  119. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide

  120. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide

  121. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide

  122. Contributing to OpenStreetMap wiki.openstreetmap.org/wiki/Beginners%27_guide

  123. Not just Bing...

  124. walking-papers.org GPS Mapping – on Paper

  125. pushpinosm.org Mobile Apps – PushPinOSM - iOS

  126. code.google.com/p/osmeditor4and Mobile Apps – Vespucci - Android

  127. None
  128. None
  129. None
  130. None
  131. None
  132. Tracking New Users resultmaps.neis-one.org/newestosm.php

  133. “Many eyes make all bugs shallow” openstreetbugs.schokokeks.org/

  134. Spotting Errors tools.geofabrik.de/osm i

  135. Spotting Errors keepright.ipax.at

  136. Contributing to OpenStreetMap Rule 1: Respect Copyright

  137. OSM Wiki: wiki.openstreetmap.org OSM Help Forums: help.openstreetmap.org OSM-F Blog: blog.osmfoundation.org

    OpenGeoData Blog (OSM News): opengeodata.org Contacting Irish Mappers: Mailing List: talk-ie@openstreetmap.org IRC: irc://irc.oftc.net #osm-ie or #osm (Twitter: @osm_ie) Contacting OSM
  138. Thank You Richard Cantwell Senior GIS Consultant / Technical Manager

    www.gamma.ie richard.cantwell@gamma.ie @ManAboutCouch