Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OpenGeoData: What, Where and Why?

OpenGeoData: What, Where and Why?

Lecture given to students of Spatial Information Science, Dublin Institute of Technology, on 23rd November 2012

Richard Cantwell

December 01, 2012
Tweet

More Decks by Richard Cantwell

Other Decks in Education

Transcript

  1. Open GeoData:
    Why, What and
    Where is it?
    Richard Cantwell
    Senior GIS Consultant /
    Technical Manager
    www.gamma.ie
    [email protected]
    @ManAboutCouch

    View Slide

  2. Cartography.. Spatial Data.. GIS.. all changing.
    www.axismaps.com/typographic.php

    View Slide

  3. www.nuim.ie/staff/dpringle/qsms.shtml
    Early Computer mapping – Belfast, 1972

    View Slide

  4. Computer mapping – Belfast, 40 years later

    View Slide

  5. Google Maps: Turning the world upside down since 2005

    View Slide

  6. Pre rendered tiles – Range of data sources
    AJAX (Asynchronous JavaScript and XML)
    Open API's - Mashups
    Rapid development – releases every 7-10
    days
    Google Earth
    Google Maps - Key Innovations
    http://berglondon.com/projects/hat/

    View Slide

  7. More Than A Map
    www.morethanamap.com

    View Slide

  8. Restrictions: (there are many, these are just a few)
    Advertising – Google reserves the right to advertise on the map
    Access – APIs can only be accessed via a Google Map
    Content – No access to raw vector data
    Transaction Limits – 25,000 Map loads per day
    Derivative work – No copying, tracing or other modification
    Offline – Very limited offline use (Android phones only)

    View Slide

  9. Open Knowledge:
    “A piece of content or data is open if you are free to use, reuse, and redistribute it
    - subject only, at most, to the requirement to attribute and share-alike.”
    www.opendefinition.org
    What is Open?
    http://flic.kr/p/7Aqgs5

    View Slide

  10. New sources of GeoData
    http://www.flickr.com/photos/walkingsf/4672160490

    View Slide

  11. Shining a Light...
    http://www.walkspace.org/namaland/

    View Slide

  12. Open not always the default option
    http://www.oobrien.com/vis/bikes/

    View Slide

  13. Dependencies – data or services can be 'switched off'

    View Slide

  14. Local Authorities getting on board
    data.fingal.ie

    View Slide

  15. Dublinked
    Dublinked.com

    View Slide

  16. opendatahandbook.org
    • Transparency and democratic control
    • Participation
    • Self-empowerment
    • Improved or new private products and services
    • Innovation
    • Improved efficiency & effectiveness of government services
    • Impact measurement of policies
    • New knowledge from combined data sources and patterns in
    large data volumes

    View Slide

  17. blog.datamarket.com
    A Private Sector View?

    View Slide

  18. Vs
    www.creativecommons.org

    View Slide

  19. Software / Data Licences

    View Slide

  20. .
    A Legal Minefield?
    discovery.ac.uk/files/pdf/Licensing_Open_Data_A_Practical_Guide.pdf

    View Slide

  21. Free (government) data isn't necessarily the answer
    www.slideshare.net/pmbatty/geodata-creationpast-present-and-future

    View Slide

  22. No Data is Perfect, even expensive Commercial Data

    View Slide

  23. No Data is Perfect, even expensive Commercial Data

    View Slide

  24. Bad POI Data

    View Slide

  25. View Slide

  26. View Slide

  27. View Slide

  28. The future of commercial online mapping?
    Logorama: vimeo.com/10149605

    View Slide

  29. The future of commercial online mapping?
    www.citymaps.com

    View Slide

  30. tools.geofabrik.de/mc

    View Slide

  31. tools.geofabrik.de/mc

    View Slide

  32. Global Scale Commercial GeoData Suppliers

    View Slide

  33. Acquisitions Completed Late 2007 / Early 2008

    View Slide

  34. € 8,600,000,000
    € 5,700,000,000
    € 2,900,000,000
    How Much?

    View Slide

  35. “Database Creation and Delivery Costs”
    Q1 2008: $115,423,000
    Annualised: $461,692,000
    From last earnings report before Nokia acquisition

    View Slide

  36. 1,100 Staff
    6,000 Contractors
    http://read.bi/MrAi0j

    View Slide

  37. € 25,000,000
    Annual Report 2010
    Annual Running Cost

    View Slide

  38. £ 34,918
    http://www.osmfoundation.org/wiki/Finances/Income_2011
    (Income: £ 58,869)
    Expenses 2011

    View Slide

  39. ITO OpenStreetMap Year of Edits Video - 2011
    https://vimeo.com/48984270

    View Slide

  40. View Slide

  41. View Slide

  42. View Slide

  43. OpenStreetMap
    www.openstreetmap.org

    View Slide

  44. View Slide

  45. Large Community: 600,000 Users. Rapid Growth: 75% in 2011
    www.beyonav.com/openstreetmaps-growth-accelerates

    View Slide

  46. www.itoworld.com/map/main

    View Slide

  47. www.itoworld.com/map/main

    View Slide

  48. www.itoworld.com/map/main

    View Slide

  49. www.itoworld.com/map/main

    View Slide

  50. www.itoworld.com/map/main

    View Slide

  51. SRTM
    www.opencyclemap.org

    View Slide

  52. maps.openstreetmap.ie

    View Slide

  53. CORINE Landcover
    maps.openstreetmap.ie/corineimport.html

    View Slide

  54. maps.openstreetmap.ie

    View Slide

  55. Web mapping: Gaining Functionality
    map.project-osrm.org

    View Slide

  56. Raw Vector Data available

    View Slide

  57. View Slide

  58. maps.stamen.com/watercolor

    View Slide

  59. Tile Data
    maps.stamen.com

    View Slide

  60. izeize.com/openmaps

    View Slide

  61. Recent Announcements of Switches to and Support for OSM

    View Slide

  62. * SLA’s available from 3rd parties (€€). Self-hosting is cheap but can be complex.
    OpenStreetMap
    • API’s aimed at data editors
    • Limited API functionality
    • No ‘Service Level Agreements’*
    • ‘Viral’ nature of data licence
    • Focus on map data
    • ‘Warm Geography’
    • Instant data updates, Sporadic
    • ‘Depth’ Issues (coverage, completeness)
    • Metadata
    Other Data Providers:
    • API’s aimed at data consumers
    • Extensive API functionality
    • SLA’s available (but €€)
    • Derived data issues
    • Focus on services
    • ‘Cold Geography’
    • Moderated update process, Consistent
    • ‘Width’ issues (limited featureset)
    • Pricing

    View Slide

  63. Formats and Metadata are important.. but..
    Vs
    A 'do-ocracy':
    “Build it and get out of the way”
    Top-down approach.

    View Slide

  64. opendatacommons.org/licenses/odbl/summary

    View Slide

  65. Privacy / Data Protection
    petewarden.github.com/iPhoneTracker

    View Slide

  66. GeoData Sources
    (some more open than others)

    View Slide

  67. maps.osi.ie/publicviewer

    View Slide

  68. www.npws.ie/mapsanddata

    View Slide

  69. gis.epa.ie/betazone/envision/

    View Slide

  70. airomaps.nuim.ie/census2011

    View Slide

  71. www.dcenr.gov.ie/Spatial+Dat
    GSI / DCENR: An Irish Open Data Pioneer?

    View Slide

  72. www.dcenr.gov.ie/Spatial+Dat
    GSI / DCENR: An Irish Open Data Pioneer?

    View Slide

  73. www.isde.ie
    The Irish Spatial Data Exchange

    View Slide

  74. DubLinked
    dublinked.com

    View Slide

  75. Spatial is Popular

    View Slide

  76. opendata.ie
    A wider movement..

    View Slide

  77. SRTM
    srtm.csi.cgiar.org

    View Slide

  78. Continuous Variance: Surface

    View Slide

  79. GeoNames
    www.geonames.org

    View Slide

  80. Geonames
    www.geonames.org

    View Slide

  81. GeoNames Visualised
    www.datapointed.net/2011/01/happy-new-year

    View Slide

  82. Landsat
    http://zulu.ssc.nasa.gov/mrsid/mrsid.p
    l

    View Slide

  83. Entire Planet downloadable (~500GB uncompressed)
    planet.openstreetmap.org

    View Slide

  84. Entire Planet downloadable (~500GB uncompressed)
    planet.openstreetmap.org

    View Slide

  85. Processed data downloads & services
    www.geofabrik.de

    View Slide

  86. download.geofabrik.de

    View Slide

  87. download.geofabrik.de
    Including pre-configured Shapefiles (reduced featureset)

    View Slide

  88. Cartography.. Spatial Data.. GIS.. all changing.
    www.axismaps.com/typographic.php

    View Slide

  89. Cartography.. Spatial Data.. GIS.. all changing.
    www.axismaps.com/typographic.php

    View Slide

  90. Cartography.. Spatial Data.. GIS.. all changing.
    www.axismaps.com/typographic.php

    View Slide

  91. View Slide

  92. www.gamma.ie

    View Slide

  93. www.autoaddress.ie
    Irish Geocoding

    View Slide

  94. Using OSM Data

    View Slide

  95. Static Data APIs: xapi / OverPass
    overpass-api.de

    View Slide

  96. View Slide

  97. Tile Data

    View Slide

  98. Tile Data Pyramid
    tile.openstreetmap.org/0/0/0.png
    tile.openstreetmap.org/10/494/331.png
    tile.openstreetmap.org/18/126521/84975.png

    View Slide

  99. OpenStreetMap – Tile Usage
    wiki.openstreetmap.org/wiki/Tile_Disk_Usage
    OSM does NOT pre-render every tile.
    Pre-rendering all tiles would use around 54,000 GB of
    storage.
    The majority of tiles are never viewed. In fact just
    1.79% have ever been viewed.
    This is because the majority of tiles are at zoom
    level 18 and the vast majority of those contain nothing
    of interest (the sea, for example)
    By following an on-the-fly rendering approach we can
    avoid rendering these tiles unnecessarily.
    The tile view count column shows how many tiles have
    been produced on the OSM Tile server.
    Tile server disk usage: 1,272 GB used. (6 Jan 2012).
    (z0 to z15: 252 GB, z16 to z18: 1,020 GB)

    View Slide

  100. Edit Store Render Consume
    Store Analyse

    View Slide

  101. Using OSM data in GIS

    View Slide

  102. View Slide

  103. View Slide

  104. Daft.ie Switch to OSM – March 2012
    www.switch2osm.org

    View Slide

  105. www.mapbox.com/tilemill

    View Slide

  106. www.mapbox.com/tilemill

    View Slide

  107. www.mapbox.com/tilemill

    View Slide

  108. Contributing to OSM

    View Slide

  109. Contributing to OpenStreetMap
    Rule 1: Respect Copyright

    View Slide

  110. 30cm Imagery available for tracing
    2.7m RMSE

    View Slide

  111. The impact of High Resolution imagery

    View Slide

  112. wiki.openstreetmap.org/wiki/Bing

    View Slide

  113. wiki.openstreetmap.org/wiki/National_Library_of_Scotland

    View Slide

  114. wiki.openstreetmap.org/wiki/Beginners%27_guide
    Contributing to OpenStreetMap

    View Slide

  115. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View Slide

  116. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View Slide

  117. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View Slide

  118. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View Slide

  119. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View Slide

  120. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View Slide

  121. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View Slide

  122. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View Slide

  123. Not just Bing...

    View Slide

  124. walking-papers.org
    GPS Mapping – on Paper

    View Slide

  125. pushpinosm.org
    Mobile Apps – PushPinOSM - iOS

    View Slide

  126. code.google.com/p/osmeditor4and
    Mobile Apps – Vespucci - Android

    View Slide

  127. View Slide

  128. View Slide

  129. View Slide

  130. View Slide

  131. View Slide

  132. Tracking New Users
    resultmaps.neis-one.org/newestosm.php

    View Slide

  133. “Many eyes make all bugs shallow”
    openstreetbugs.schokokeks.org/

    View Slide

  134. Spotting Errors
    tools.geofabrik.de/osm
    i

    View Slide

  135. Spotting Errors
    keepright.ipax.at

    View Slide

  136. Contributing to OpenStreetMap
    Rule 1: Respect Copyright

    View Slide

  137. OSM Wiki:
    wiki.openstreetmap.org
    OSM Help Forums:
    help.openstreetmap.org
    OSM-F Blog:
    blog.osmfoundation.org
    OpenGeoData Blog (OSM News):
    opengeodata.org
    Contacting Irish Mappers:
    Mailing List: [email protected]
    IRC: irc://irc.oftc.net #osm-ie or #osm
    (Twitter: @osm_ie)
    Contacting OSM

    View Slide

  138. Thank You Richard Cantwell
    Senior GIS Consultant /
    Technical Manager
    www.gamma.ie
    [email protected]
    @ManAboutCouch

    View Slide