Big Data Week - Presentation 3

Big Data From Space

Big Data Week @Pawsey presentation

Transcript

1. Australian Copernicus Data Hub Data sources and tools Big Data From Space: Data sources and tools Daniel Marrable daniel.marrable@landgate.wa.gov.au Keith Moss keith.moss@landgate.wa.gov.au Landgate Satellite Remote Sensing Services Imagery, Product Delivery
2. Australian Copernicus Data Hub Data sources and tools Introduction  How to access Sentinel Data  Internationally  Australia  Sentinal Australia Regional Access SARA  Web  API  Open Data  Landgate  Pawsey  Tools
3. Australian Copernicus Data Hub Data sources and tools https://scihub.copernicus.eu/ ESA’s Sci-hub Pro The-most-up-to-date Free API SNAP integration Con Download limits Slow “Clunky” Format  .SAFE
4. Australian Copernicus Data Hub Data sources and tools http://sentinel-pds.s3-website.eu-central-1.amazonaws.com/ Amazon Web Services AWS Pro  Intergration with AWS cloud services  Free Con  File format  File discovery Format  JP2
5. Australian Copernicus Data Hub Data sources and tools https://eros.usgs.gov/sentinel-2 The United States Geological Survey USGS Pro Integrated search with other satellites GIS tool integration Free Con  File format Format  JP2  GeoTIFF
6. Australian Copernicus Data Hub Data sources and tools https://remotepixel.ca/projects/satellitesearch.html Numerous 3rd Party Applictions  3rd Party Services  WMS  Cloud processing  Automation services  Continuous monitoring   Examples   Sentinel-2 WMS service by Sinergise  Sentinel imagery viewer by Remote Pixel  Sentinel imagery service by Astro Digital  Postcards from Space  SatCat - interactive satellite imagery browser  Sentinel2 Product Ingestor
7. Australian Copernicus Data Hub Data sources and tools http://www.copernicus.gov.au/ Sentinel Australia Regional Access SARA Early Access - Preview
8. Australian Copernicus Data Hub Data sources and tools http://www.copernicus.gov.au/ Sentinel Australia Regional Access SARA Early Access - Preview
9. Australian Copernicus Data Hub Data sources and tools http://www.copernicus.gov.au/ Sentinel Australia Regional Access SARA Early Access - Preview
10. Australian Copernicus Data Hub Data sources and tools http://www.copernicus.gov.au/ Sentinel Australia Regional Access SARA Early Access - Preview
11. Australian Copernicus Data Hub Data sources and tools http://www.copernicus.gov.au/ Sentinel Australia Regional Access SARA Early Access - Preview
12. Australian Copernicus Data Hub Data sources and tools http://www.opensearch.org/Home Sentinel Australia Regional Access SARA Early Access - Preview API (WIP)  Based on open search Standard  Interrogate all Metadata
13. Australian Copernicus Data Hub Data sources and tools Why?  ACDH Working with ESA to optimise data flow into Australia  Eliminate bottle necks  Faster access to data  Greater data integrity  Data sits closer to Australian eResearch infrastructure  Better coverage of Australia and Austrlian coast
14. Australian Copernicus Data Hub Data sources and tools Early work Networking issues were causing data corruption
15. Australian Copernicus Data Hub Data sources and tools  Networking issues were causing data corruption And slow data tranfer
16. Australian Copernicus Data Hub Data sources and tools  Current status  Early work
17. Australian Copernicus Data Hub Data sources and tools Early Work Current Status
18. Australian Copernicus Data Hub Data sources and tools Open Data: Open data and content can be freely used, modified, and shared by anyone for any purpose Landgate
19. Australian Copernicus Data Hub Data sources and tools The home for Western Australian government data Data from over 40 state agencies discoverable in one place. Supported by the state’s Open Data Policy. Geospatial and more Building on the collaborative efforts of Shared Location Information Platform (SLIP) geospatial data infrastructure. A growing catalogue of data from beyond geospatial, and other domains.
20. Australian Copernicus Data Hub Data sources and tools Available for reuse Data made as easy to access and use as possible and avoid restrictive licenses. Easily discoverable Data should be easy to find in one place. That makes the information easy to find no matter how people come to government. Machine-readable Data made available in machine-readable formats, and via APIs where possible, to enable reuse and integration. Open Data Principles
21. Australian Copernicus Data Hub Data sources and tools Website http://data.gov.au
22. Australian Copernicus Data Hub Data sources and tools Copernicus satellite data will be discoverable from its home on data.wa.gov.au and hosted at Pawsey for use in Western Australia.
23. Australian Copernicus Data Hub Data sources and tools Standardised metadata profile giving an overview of each dataset. Access Pawsey-hosted datasets and additional metadata directly from “Data and resources”. Direct data download and APIs.
24. Australian Copernicus Data Hub Data sources and tools Access Copernicus data together in one place - group together and in themed groups for climate, marine, agriculture, health, and more.
25. Australian Copernicus Data Hub Data sources and tools Innovative products and uses of data can be showcased and linked right back to the data that powered it.
26. Australian Copernicus Data Hub Data sources and tools Tools  GIS  JP2  GeoTIFF  WMS   Sentinel Application Platform (SNAP)  SAFE  ESA supported toolboxes (Sen2Cor)   Web Technologies  WMS   Appliction libraries  Amazon AWS  USGS  ESA SciHub  Australian Copernicus Data Hub  Pawsey  3rd Party Proprietary  Search Github
27. Australian Copernicus Data Hub Data sources and tools Thank you Resources • https://scihub.copernicus.eu/dhus/#/ho me • https://earthexplorer.usgs.gov/ • http://sentinel-s2- l1c.s3.amazonaws.com/ • http://www.esri.com/arcgis/about-arcgis • https://fetch.astrodigital.com/#/map/1 • http://www.opensearch.org/Home • http://www.copernicus.gov.au/ • https://remotepixel.ca/projects/satellite search.html • https://github.com/senbox-org/