Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OpenGeoData: What, Where and Why?

OpenGeoData: What, Where and Why?

Lecture given to students of Spatial Information Science, Dublin Institute of Technology, on 23rd November 2012

Richard Cantwell

December 01, 2012
Tweet

More Decks by Richard Cantwell

Other Decks in Education

Transcript

  1. Open GeoData:
    Why, What and
    Where is it?
    Richard Cantwell
    Senior GIS Consultant /
    Technical Manager
    www.gamma.ie
    [email protected]
    @ManAboutCouch

    View full-size slide

  2. Cartography.. Spatial Data.. GIS.. all changing.
    www.axismaps.com/typographic.php

    View full-size slide

  3. www.nuim.ie/staff/dpringle/qsms.shtml
    Early Computer mapping – Belfast, 1972

    View full-size slide

  4. Computer mapping – Belfast, 40 years later

    View full-size slide

  5. Google Maps: Turning the world upside down since 2005

    View full-size slide

  6. Pre rendered tiles – Range of data sources
    AJAX (Asynchronous JavaScript and XML)
    Open API's - Mashups
    Rapid development – releases every 7-10
    days
    Google Earth
    Google Maps - Key Innovations
    http://berglondon.com/projects/hat/

    View full-size slide

  7. More Than A Map
    www.morethanamap.com

    View full-size slide

  8. Restrictions: (there are many, these are just a few)
    Advertising – Google reserves the right to advertise on the map
    Access – APIs can only be accessed via a Google Map
    Content – No access to raw vector data
    Transaction Limits – 25,000 Map loads per day
    Derivative work – No copying, tracing or other modification
    Offline – Very limited offline use (Android phones only)

    View full-size slide

  9. Open Knowledge:
    “A piece of content or data is open if you are free to use, reuse, and redistribute it
    - subject only, at most, to the requirement to attribute and share-alike.”
    www.opendefinition.org
    What is Open?
    http://flic.kr/p/7Aqgs5

    View full-size slide

  10. New sources of GeoData
    http://www.flickr.com/photos/walkingsf/4672160490

    View full-size slide

  11. Shining a Light...
    http://www.walkspace.org/namaland/

    View full-size slide

  12. Open not always the default option
    http://www.oobrien.com/vis/bikes/

    View full-size slide

  13. Dependencies – data or services can be 'switched off'

    View full-size slide

  14. Local Authorities getting on board
    data.fingal.ie

    View full-size slide

  15. Dublinked
    Dublinked.com

    View full-size slide

  16. opendatahandbook.org
    • Transparency and democratic control
    • Participation
    • Self-empowerment
    • Improved or new private products and services
    • Innovation
    • Improved efficiency & effectiveness of government services
    • Impact measurement of policies
    • New knowledge from combined data sources and patterns in
    large data volumes

    View full-size slide

  17. blog.datamarket.com
    A Private Sector View?

    View full-size slide

  18. Vs
    www.creativecommons.org

    View full-size slide

  19. Software / Data Licences

    View full-size slide

  20. .
    A Legal Minefield?
    discovery.ac.uk/files/pdf/Licensing_Open_Data_A_Practical_Guide.pdf

    View full-size slide

  21. Free (government) data isn't necessarily the answer
    www.slideshare.net/pmbatty/geodata-creationpast-present-and-future

    View full-size slide

  22. No Data is Perfect, even expensive Commercial Data

    View full-size slide

  23. No Data is Perfect, even expensive Commercial Data

    View full-size slide

  24. Bad POI Data

    View full-size slide

  25. The future of commercial online mapping?
    Logorama: vimeo.com/10149605

    View full-size slide

  26. The future of commercial online mapping?
    www.citymaps.com

    View full-size slide

  27. tools.geofabrik.de/mc

    View full-size slide

  28. tools.geofabrik.de/mc

    View full-size slide

  29. Global Scale Commercial GeoData Suppliers

    View full-size slide

  30. Acquisitions Completed Late 2007 / Early 2008

    View full-size slide

  31. € 8,600,000,000
    € 5,700,000,000
    € 2,900,000,000
    How Much?

    View full-size slide

  32. “Database Creation and Delivery Costs”
    Q1 2008: $115,423,000
    Annualised: $461,692,000
    From last earnings report before Nokia acquisition

    View full-size slide

  33. 1,100 Staff
    6,000 Contractors
    http://read.bi/MrAi0j

    View full-size slide

  34. € 25,000,000
    Annual Report 2010
    Annual Running Cost

    View full-size slide

  35. £ 34,918
    http://www.osmfoundation.org/wiki/Finances/Income_2011
    (Income: £ 58,869)
    Expenses 2011

    View full-size slide

  36. ITO OpenStreetMap Year of Edits Video - 2011
    https://vimeo.com/48984270

    View full-size slide

  37. OpenStreetMap
    www.openstreetmap.org

    View full-size slide

  38. Large Community: 600,000 Users. Rapid Growth: 75% in 2011
    www.beyonav.com/openstreetmaps-growth-accelerates

    View full-size slide

  39. www.itoworld.com/map/main

    View full-size slide

  40. www.itoworld.com/map/main

    View full-size slide

  41. www.itoworld.com/map/main

    View full-size slide

  42. www.itoworld.com/map/main

    View full-size slide

  43. www.itoworld.com/map/main

    View full-size slide

  44. SRTM
    www.opencyclemap.org

    View full-size slide

  45. maps.openstreetmap.ie

    View full-size slide

  46. CORINE Landcover
    maps.openstreetmap.ie/corineimport.html

    View full-size slide

  47. maps.openstreetmap.ie

    View full-size slide

  48. Web mapping: Gaining Functionality
    map.project-osrm.org

    View full-size slide

  49. Raw Vector Data available

    View full-size slide

  50. maps.stamen.com/watercolor

    View full-size slide

  51. Tile Data
    maps.stamen.com

    View full-size slide

  52. izeize.com/openmaps

    View full-size slide

  53. Recent Announcements of Switches to and Support for OSM

    View full-size slide

  54. * SLA’s available from 3rd parties (€€). Self-hosting is cheap but can be complex.
    OpenStreetMap
    • API’s aimed at data editors
    • Limited API functionality
    • No ‘Service Level Agreements’*
    • ‘Viral’ nature of data licence
    • Focus on map data
    • ‘Warm Geography’
    • Instant data updates, Sporadic
    • ‘Depth’ Issues (coverage, completeness)
    • Metadata
    Other Data Providers:
    • API’s aimed at data consumers
    • Extensive API functionality
    • SLA’s available (but €€)
    • Derived data issues
    • Focus on services
    • ‘Cold Geography’
    • Moderated update process, Consistent
    • ‘Width’ issues (limited featureset)
    • Pricing

    View full-size slide

  55. Formats and Metadata are important.. but..
    Vs
    A 'do-ocracy':
    “Build it and get out of the way”
    Top-down approach.

    View full-size slide

  56. opendatacommons.org/licenses/odbl/summary

    View full-size slide

  57. Privacy / Data Protection
    petewarden.github.com/iPhoneTracker

    View full-size slide

  58. GeoData Sources
    (some more open than others)

    View full-size slide

  59. maps.osi.ie/publicviewer

    View full-size slide

  60. www.npws.ie/mapsanddata

    View full-size slide

  61. gis.epa.ie/betazone/envision/

    View full-size slide

  62. airomaps.nuim.ie/census2011

    View full-size slide

  63. www.dcenr.gov.ie/Spatial+Dat
    GSI / DCENR: An Irish Open Data Pioneer?

    View full-size slide

  64. www.dcenr.gov.ie/Spatial+Dat
    GSI / DCENR: An Irish Open Data Pioneer?

    View full-size slide

  65. www.isde.ie
    The Irish Spatial Data Exchange

    View full-size slide

  66. DubLinked
    dublinked.com

    View full-size slide

  67. Spatial is Popular

    View full-size slide

  68. opendata.ie
    A wider movement..

    View full-size slide

  69. SRTM
    srtm.csi.cgiar.org

    View full-size slide

  70. Continuous Variance: Surface

    View full-size slide

  71. GeoNames
    www.geonames.org

    View full-size slide

  72. Geonames
    www.geonames.org

    View full-size slide

  73. GeoNames Visualised
    www.datapointed.net/2011/01/happy-new-year

    View full-size slide

  74. Landsat
    http://zulu.ssc.nasa.gov/mrsid/mrsid.p
    l

    View full-size slide

  75. Entire Planet downloadable (~500GB uncompressed)
    planet.openstreetmap.org

    View full-size slide

  76. Entire Planet downloadable (~500GB uncompressed)
    planet.openstreetmap.org

    View full-size slide

  77. Processed data downloads & services
    www.geofabrik.de

    View full-size slide

  78. download.geofabrik.de

    View full-size slide

  79. download.geofabrik.de
    Including pre-configured Shapefiles (reduced featureset)

    View full-size slide

  80. Cartography.. Spatial Data.. GIS.. all changing.
    www.axismaps.com/typographic.php

    View full-size slide

  81. Cartography.. Spatial Data.. GIS.. all changing.
    www.axismaps.com/typographic.php

    View full-size slide

  82. Cartography.. Spatial Data.. GIS.. all changing.
    www.axismaps.com/typographic.php

    View full-size slide

  83. www.gamma.ie

    View full-size slide

  84. www.autoaddress.ie
    Irish Geocoding

    View full-size slide

  85. Using OSM Data

    View full-size slide

  86. Static Data APIs: xapi / OverPass
    overpass-api.de

    View full-size slide

  87. Tile Data Pyramid
    tile.openstreetmap.org/0/0/0.png
    tile.openstreetmap.org/10/494/331.png
    tile.openstreetmap.org/18/126521/84975.png

    View full-size slide

  88. OpenStreetMap – Tile Usage
    wiki.openstreetmap.org/wiki/Tile_Disk_Usage
    OSM does NOT pre-render every tile.
    Pre-rendering all tiles would use around 54,000 GB of
    storage.
    The majority of tiles are never viewed. In fact just
    1.79% have ever been viewed.
    This is because the majority of tiles are at zoom
    level 18 and the vast majority of those contain nothing
    of interest (the sea, for example)
    By following an on-the-fly rendering approach we can
    avoid rendering these tiles unnecessarily.
    The tile view count column shows how many tiles have
    been produced on the OSM Tile server.
    Tile server disk usage: 1,272 GB used. (6 Jan 2012).
    (z0 to z15: 252 GB, z16 to z18: 1,020 GB)

    View full-size slide

  89. Edit Store Render Consume
    Store Analyse

    View full-size slide

  90. Using OSM data in GIS

    View full-size slide

  91. Daft.ie Switch to OSM – March 2012
    www.switch2osm.org

    View full-size slide

  92. www.mapbox.com/tilemill

    View full-size slide

  93. www.mapbox.com/tilemill

    View full-size slide

  94. www.mapbox.com/tilemill

    View full-size slide

  95. Contributing to OSM

    View full-size slide

  96. Contributing to OpenStreetMap
    Rule 1: Respect Copyright

    View full-size slide

  97. 30cm Imagery available for tracing
    2.7m RMSE

    View full-size slide

  98. The impact of High Resolution imagery

    View full-size slide

  99. wiki.openstreetmap.org/wiki/Bing

    View full-size slide

  100. wiki.openstreetmap.org/wiki/National_Library_of_Scotland

    View full-size slide

  101. wiki.openstreetmap.org/wiki/Beginners%27_guide
    Contributing to OpenStreetMap

    View full-size slide

  102. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View full-size slide

  103. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View full-size slide

  104. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View full-size slide

  105. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View full-size slide

  106. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View full-size slide

  107. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View full-size slide

  108. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View full-size slide

  109. Contributing to OpenStreetMap
    wiki.openstreetmap.org/wiki/Beginners%27_guide

    View full-size slide

  110. Not just Bing...

    View full-size slide

  111. walking-papers.org
    GPS Mapping – on Paper

    View full-size slide

  112. pushpinosm.org
    Mobile Apps – PushPinOSM - iOS

    View full-size slide

  113. code.google.com/p/osmeditor4and
    Mobile Apps – Vespucci - Android

    View full-size slide

  114. Tracking New Users
    resultmaps.neis-one.org/newestosm.php

    View full-size slide

  115. “Many eyes make all bugs shallow”
    openstreetbugs.schokokeks.org/

    View full-size slide

  116. Spotting Errors
    tools.geofabrik.de/osm
    i

    View full-size slide

  117. Spotting Errors
    keepright.ipax.at

    View full-size slide

  118. Contributing to OpenStreetMap
    Rule 1: Respect Copyright

    View full-size slide

  119. OSM Wiki:
    wiki.openstreetmap.org
    OSM Help Forums:
    help.openstreetmap.org
    OSM-F Blog:
    blog.osmfoundation.org
    OpenGeoData Blog (OSM News):
    opengeodata.org
    Contacting Irish Mappers:
    Mailing List: [email protected]
    IRC: irc://irc.oftc.net #osm-ie or #osm
    (Twitter: @osm_ie)
    Contacting OSM

    View full-size slide

  120. Thank You Richard Cantwell
    Senior GIS Consultant /
    Technical Manager
    www.gamma.ie
    [email protected]
    @ManAboutCouch

    View full-size slide