Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Worldwide Terrain and Cloud Infrastructure: an update on Stamen's Knight Grant

Worldwide Terrain and Cloud Infrastructure: an update on Stamen's Knight Grant

Seth Fitzsimmons

March 11, 2015
Tweet

More Decks by Seth Fitzsimmons

Other Decks in Technology

Transcript

  1. Worldwide Terrain
    and
    Cloud Infrastructure:
    an update on Stamen’s

    Knight Grant
    Seth Fitzsimmons

    Stamen Design

    View full-size slide

  2. what is the Knight
    Foundation?

    View full-size slide

  3. Knight Foundation supports transformational ideas
    that promote quality journalism, advance media
    innovation, engage communities and foster the arts.
    We believe that democracy thrives when people
    and communities are informed and engaged.


    - John S. and James L. Knight Foundation

    View full-size slide

  4. what is Stamen?

    View full-size slide

  5. cloud-based infrastructure

    View full-size slide

  6. worldwide terrain

    View full-size slide

  7. accessible and open
    process

    View full-size slide

  8. [background]

    View full-size slide

  9. previously…

    View full-size slide

  10. dotspotting.org

    View full-size slide

  11. no pressure.

    View full-size slide

  12. meanwhile…

    View full-size slide

  13. 6/2011: launch

    View full-size slide

  14. 3/2012: watercolor

    View full-size slide

  15. 12/2013: 240m tiles

    View full-size slide

  16. 12/2014: 960m tiles

    View full-size slide

  17. modernization

    View full-size slide

  18. Running Your Own
    Rendering
    Infrastructure
    Seth Fitzsimmons

    Stamen Design
    http://flic.kr/p/8sJotc

    View full-size slide

  19. updated data

    View full-size slide

  20. style tweaks

    View full-size slide

  21. Cascadenik → CartoCSS

    View full-size slide

  22. TileStache → tessera

    View full-size slide

  23. ModestMaps → Leaflet

    View full-size slide

  24. self-hosted → AWS

    View full-size slide

  25. more accessible (?)

    View full-size slide

  26. (continental) US only

    View full-size slide

  27. ∞ terrain maps

    View full-size slide

  28. duplication
    (unless necessary)

    View full-size slide

  29. “best available
    open data”

    View full-size slide


  30. BoF @ 7:30

    View full-size slide

  31. open (+ documented)
    process
    (work-in-progress: please help!)

    View full-size slide

  32. (watching / collaborating
    with OpenAerialMap)
    BoF @ 8:30

    View full-size slide

  33. institutional sources
    (NASA, USGS, …)

    View full-size slide

  34. individual sources
    (OpenDroneMap)

    View full-size slide

  35. [architecture]

    View full-size slide

  36. cheap, simple, novel

    View full-size slide

  37. storage via HTTP
    (S3)

    View full-size slide

  38. overviews as
    distinct layers

    View full-size slide

  39. rendered via
    Mapnik / GDAL

    View full-size slide

  40. horizontal processing w/
    GDAL
    (SQS / SWF)

    View full-size slide

  41. VRTs
    (virtual raster tables)

    View full-size slide

  42. VSICurl
    /vsicurl/http://…

    View full-size slide

  43. PostgreSQL / PostGIS

    View full-size slide

  44. PostgreSQL / PostGIS

    View full-size slide

  45. out-db + S3 =

    View full-size slide

  46. (caching gotchas)

    View full-size slide

  47. 100⨉100 px tiles =

    View full-size slide

  48. Mapnik + GDAL +
    VRTs + FUSE

    View full-size slide

  49. Filesystem in User Space

    View full-size slide

  50. empowering journalists

    View full-size slide

  51. help tell stories

    View full-size slide

  52. support pipeline reuse

    View full-size slide

  53. let’s figure this thing out!
    [email protected]
    openterrain.tumblr.com

    View full-size slide