Upgrade to Pro — share decks privately, control downloads, hide ads and more …

GSCB - CNES current and planned activities with...

GSCB - CNES current and planned activities within the Ground Segment directory

GSCB - Roma, Italia - 2013.04.11

Overview of current and planned activities within the CNES Ground Segment directory.

Keywords: WPS, EO, Phoebus, Linked Data, Altimetry

Jérôme Gasperi

April 16, 2013
Tweet

More Decks by Jérôme Gasperi

Other Decks in Technology

Transcript

  1. Current infrastructures & platforms Land Surfaces Thematic Center Altimetry Ground

    Segment Phoeßus On going R&Ts WPS Linked data Planned activities OWS-10 OGC testbed
  2. "The objective of the center is to facilitate the study

    of issues related to the impact of anthropogenic pressures on climate and ecosystems, quantify and model the water cycle and carbon monitoring developments of societies and their activities, understand the dynamics of biodiversity."
  3. To achieve this objective, the center will develop and make

    available to the scientific community data, products, processes and services related to the observation from space land surfaces.
  4. CNES METACATALOG GEOSUD Kalideos Land Surfaces Portal POSTEL Spirit Hydroweb

    Landsat South France IGN Take5 PTSC by end of 2013 ~1000 products France Very High resolution cover ~ 120 000 products OpenSearch (1) OpenSearch (1) CSW ISO CSW CIM (1) OpenSearch to be aligned with HMA-S specification
  5. CNES METACATALOG GEOSUD Kalideos Land Surfaces Portal SENTINEL 2 SPOT

    Archive POSTEL Spirit Hydroweb Landsat South France IGN Take5 PTSC mid to long term objective ~ 120 000 products ~1000 products France Very High resolution cover ~ 400 000 products Huge amount of products Whole Earth CSW ISO CSW CIM OpenSearch (1) OpenSearch (1) (1) OpenSearch to be aligned with HMA-S specification
  6. Simplify access to product "Get what you want" - provide

    data extraction service to limit download to a subset based on geographical extent, time interval and/or physical parameters - [short term objective] "Get fresh products" - process data on demand to shorten delivery time (e.g. no need to wait for a full reprocessing of Level 2 products with newer algorithm/model/etc.) - [mid term objective]
  7. A fully integrated workflow execution framework Esay integration of processing

    chains Ressource management User friendly GUI Hardware configuration, allocation and monitoring
  8. Phoeßus Inventory Production Processing server Processing server Execution Events Processing

    center Event manager Workflow engine Administration & supervision Job management system
  9. Phoeßus Inventory Production Processing server Processing server Execution Events Processing

    center Event manager Workflow engine Administration & supervision Job management system Monitor and Command of the Data Production Centre (startup/shutdown, etc. Monitor and Command of the hardware components status (nodes of the clust On Line Help of the Data Production Centre No human intervention is required in nominal operation Administration & supervision
  10. Phoeßus Inventory Production Processing server Processing server Execution Events Processing

    center Event manager Workflow engine Administration & supervision Job management system Detects processing events described in an XML configuration file - data events, time events, stream events, web services events (WPS), user events Event manager
  11. Phoeßus Inventory Production Processing server Processing server Execution Events Processing

    center Event manager Workflow engine Administration & supervision Job management system Generates & manages workplan automatically or manually (MMI) Orchestrates & parallelizes the execution according to execution events (errors, crash) and operator orders (stop, resume, cancel, change priority, replan) Workflow engine
  12. Phoeßus Inventory Production Processing server Processing server Execution Events Processing

    center Event manager Workflow engine Administration & supervision Job management system Processes the parallelization level on run-time Supports both CNES-LAI and ESA-JobOrder interfaces, Monitors and controls the execution of the software executable delegated to Phoebus-JobManagement component. Processing server Processing server
  13. Phoeßus Inventory Production Processing server Processing server Execution Events Processing

    center Event manager Workflow engine Administration & supervision Job management system Distributes the software executable onto the cluster of processing servers on an optimized way. Support 3 different types of distributed applications (Pléiades proprietary, DRMAA vA API (e.g. Torque/Maui), Cascading Hadoop) Job management system
  14. Performance and scalability IPU-Pleiades Center (hosted in SpotImage premises) -

    500 images/day generated thanks to cluster of 52 servers (octo-core) - Raw images in case of urgent Defense needs) are delivered in less than 7mn - High level corrected images are delivered in less than 25mn
  15. WPS a WPS a Web application Orfeo Toolbox mapshup http://mapshup.info

    http://constellation-sdi.org http://orfeo-toolbox.org
  16. WPS a WPS a Web application Orfeo Toolbox mapshup http://mapshup.info

    http://constellation-sdi.org http://orfeo-toolbox.org
  17. WPS a WPS a Web application 1 1 - DescribeProcess

    request for "Classification" Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org
  18. WPS a WPS a Web application 1 1 - DescribeProcess

    request for "Classification" Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org
  19. WPS a WPS a Web application 1 1 - DescribeProcess

    request for "Classification" Classification process description 2 2 - Set up MMI from process description Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org
  20. WPS a WPS a Web application 1 1 - DescribeProcess

    request for "Classification" Classification process description 2 2 - Set up MMI from process description Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org
  21. WPS a WPS a Web application 1 1 - DescribeProcess

    request for "Classification" Classification process description 2 2 - Set up MMI from process description + Image Well known areas 3 3 - Execute an asynchronous "Classification" request Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org
  22. WPS a WPS a Web application 1 1 - DescribeProcess

    request for "Classification" Classification process description 2 2 - Set up MMI from process description + Image Well known areas 3 3 - Execute an asynchronous "Classification" request Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org
  23. WPS a WPS a Web application 1 1 - DescribeProcess

    request for "Classification" Classification process description 2 2 - Set up MMI from process description + Image Well known areas 3 3 - Execute an asynchronous "Classification" request Land Cover 4 4 - Display result retrieved as a WMS layer Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org
  24. WMS Web client EU Cloud WPS Orthorectification CNES - Orfeo

    Toobox WMS WPS Assess Quality Improve Quality Astrium Pléiades sample data Sentinel 2 simulated (?)