Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Big Data Week - Presentation 1

Big Data Week - Presentation 1

Big Data From Space

Big Data Week @Pawsey presentation

Avatar for Dan Marrable

Dan Marrable

May 12, 2017

More Decks by Dan Marrable

Other Decks in Science

Transcript

  1. Intro to Copernicus and the Hub (Matthew Adams) Landgate’s/WA Govt

    Intended Uses (Adrian Allen) Technical Details (Dan Marrable)
  2. Copernicus is a comprehensive earth monitoring programme Government Industry End

    users Research Users Data Services Sentinel Satellites Contributing Missions In Situ
  3. Copernicus Sentinels Overview SENTINEL-1 will have two polar-orbiting satellites for

    Radar based monitoring of Land and Ocean. The first SENTINEL-1 satellite was launched on 3 April 2014. Second launched 25 April 2016. SENTINEL-2 is a land monitoring mission with two polar-orbiting satellites providing high-resolution optical imagery. Vegetation, soil and coastal areas are among the monitoring objectives. First unit launched 22 June 2015. Second launched 7 Mar 2017. SENTINEL-3 will monitor sea-surface topography, sea and land surface temperature, ocean and land colour. Composed of three satellites, the mission's primary instrument is a radar altimeter, but will carry multiple instruments. First unit launched 16 Feb 2016. Second in Nov 2017. Third before 2020. SENTINEL-4 will provide continuous monitoring of the composition of the Earth's atmosphere at high temporal and spatial resolution. First unit to be launched in 2019. SENTINEL-5 will provide wide-swath, global coverage data to monitor air quality around the world. First unit is being incorporated into METOP SG – Satellite A to be launched in 2021 following METOP C. SENTINEL-5P will perform atmospheric monitoring and provide data continuity between the retirement of the Envisat satellite and NASA's Aura mission and the launch of SENTINEL-5. Launch scheduled for June 2017. SENTINEL-6 will provide continuity of the reference, high- precision ocean topography service after Jason-3.
  4. Revisit over Australia: Sentinel-1A+B: ~12 days; Sentinel-2A+B: 5 days or

    less Copernicus Constellation Deployment Schedule On-ground Storage Sentinel 6A 2014 2015 2017 2020 2021 2022 2023 2024 2025 Sentinel 1A Sentinel 1B (recurrent) Sentinel 1C (recurrent) Sentinel 1D (recurrent) Sentinel 2A Sentinel 2B (recurrent) Sentinel 2C (recurrent) Sentinel 2D (recurrent) Sentinel 3A Sentinel 3B (recurrent) Sentinel 3C (recurrent) Sentinel 3D (recurrent) Sentinel 4A (on MTG-S1) Sentinel 5 Precursor Sentinel 5A (on MetOp-SG A) Sentinel 6B Legend: Tentative launch date Qualification Acceptance Review (QAR) Flight Acceptance Review (FAR) or PreStorage Review (PSR) 2026 2016 2018 2019 FAR FAR FAR FAR FAR In-orbit Commissioning On-ground Storage On-ground Storage On-ground Storage FAR PSR FAR FAR On-ground Storage PSR FAR On-ground Storage PSR FAR On-ground Storage PSR Sentinel 4B - On-ground Storage (FAR Q1/2029) 2027 Sentinel 5A delivery to MetOp-SG Sentinel 5A delivery to MetOp-SG Integration Sentinel 4B delivery to MTG-S2 Sentinel 4A delivery to MTG-S1 Integration Integration QAR FAR Status: 08 September 2016 QAR FAR PSR Sentinel 5B delivery to MetOp-SG Sentinel 5B delivery to MetOp-SG On-ground Storage Sentinel 5C delivery to MetOp-SG Sentinel 5C delivery to MetOp-SG On-ground Storage On-ground Storage S1 S2 S3 S4 S5 S6
  5. Copernicus & Australia Cooperation Arrangement between the European Commission and

    the Australian Government Technical Operating Arrangement with European Space Agency on operational (data transfer) research and calibration relating to Copernicus (S1, S2, S3-Land) Technical Operating Arrangement with EUMETSAT on operational (data transfer) research and calibration relating to Copernicus (S3-Marine, S4, S5, S6) Regional Data Hub for All Sentinels
  6. Australia’s Regional Copernicus Data Hub Distribute and promote data from

    the Sentinel missions Support government information requirements. Support the broader objective of enhancing access to satellite Earth observation data by research, industry and civil society. Facilitate collaboration between Australians, Europeans and inhabitants of the South-East Asia-South Pacific region Benefits for: Australia, the region, EC/ESA/EUMETSAT, and the global satellite EO community.
  7. Data Types Mission / Instrument Level-0 Level-1 Level-2 NCI Archive

    Sentinel-1 SAR RAW SLC GRD OCN 184 TB Sentinel-2 MSI - L1C (by GA) 104 TB Sentinel-3 OLCI - OL_1_EFR OL_1_ERR 2017 Land/Water 72 TB Sentinel-3 SLSTR - SL_1_RBT 2017 Land/Water 91 TB Sentinel-3 Altimetry - SR_1_SRA SR_2_LAN SR_2_WAT 11 TB
  8. Operational Products Deep National Archives (Government Systems) Master Repository (NCI)

    ESA IntHub EUMETCAST Terrestrial GEANT/AARNET Original Format Data Files (Lustre/HSM Storage) Delivery for: Australia Region Regional Portal Now • Fast and reliable transfer – Dedicated AARNet link – EUMETCast node • Data repository at NCI – Accessed via THREDDS server
  9. Data Access • THREDDS; Re-organized • Zipped SAFE + meta

    + quicklook • User-supplied Python search tool
  10. Operational Products Deep National Archives (Government Systems) Master Repository (NCI)

    AARNET Original Format Data Files (Lustre/HSM Storage) WA/SA Repository (Pawsey) Original Format Data Files (Lustre/HSM Storage)
  11. Partnerships (pay-per-use) Operational Products Deep National Archives (Government Systems) Master

    Repository (NCI) ESA IntHub EUMETCAST Terrestrial GEANT/AARNET Original Format Data Files (HSM Storage) Delivery for: Australia Region Regional Portal Analysis-Ready Data (Lustre/spinning disk) Agreed Standards R&D for: Research/Academia Civil Society Government Industry Australia and Region Interoperable Services 2018 Cloud and HPC (Petascale) Industry Exploitation
  12. Other Data Access Hubs • ESA Open Access Hub (previous

    Scihub) • ESA Intentional Access Hub • EUMETSAT Copernicus Online Data Access