Share
Embed
GSCB - CNES current and planned activities within the Ground Segment directory
GSCB - Roma, Italia - 2013.04.11
Overview of current and planned activities within the CNES Ground Segment directory.
Keywords: WPS, EO, Phoebus, Linked Data, Altimetry
Jérôme Gasperi
April 16, 2013
Transcript
39 slides
-
Jérôme Gasperi GSCB Roma, Italia - April 11th, 2013 Current
and planned activities -
Current infrastructures & platforms Land Surfaces Thematic Center Altimetry Ground
Segment Phoeßus On going R&Ts WPS Linked data Planned activities OWS-10 OGC testbed -
Land Surfaces Thematic center (PTSC) A metacatalog to facilitate interoperability
Current infrastructures & platforms -
"The objective of the center is to facilitate the study
of issues related to the impact of anthropogenic pressures on climate and ecosystems, quantify and model the water cycle and carbon monitoring developments of societies and their activities, understand the dynamics of biodiversity." -
To achieve this objective, the center will develop and make
available to the scientific community data, products, processes and services related to the observation from space land surfaces. -
CNES METACATALOG GEOSUD Kalideos Land Surfaces Portal POSTEL Spirit Hydroweb
Landsat South France IGN Take5 PTSC by end of 2013 ~1000 products France Very High resolution cover ~ 120 000 products OpenSearch (1) OpenSearch (1) CSW ISO CSW CIM (1) OpenSearch to be aligned with HMA-S specification -
CNES METACATALOG GEOSUD Kalideos Land Surfaces Portal SENTINEL 2 SPOT
Archive POSTEL Spirit Hydroweb Landsat South France IGN Take5 PTSC mid to long term objective ~ 120 000 products ~1000 products France Very High resolution cover ~ 400 000 products Huge amount of products Whole Earth CSW ISO CSW CIM OpenSearch (1) OpenSearch (1) (1) OpenSearch to be aligned with HMA-S specification -
Simplify access to product "Get what you want" - provide
data extraction service to limit download to a subset based on geographical extent, time interval and/or physical parameters - [short term objective] "Get fresh products" - process data on demand to shorten delivery time (e.g. no need to wait for a full reprocessing of Level 2 products with newer algorithm/model/etc.) - [mid term objective] -
Phoeßus Processing High level Orchestration Engine and BUsiness Services Current
infrastructures & platforms -
A fully integrated workflow execution framework Esay integration of processing
chains Ressource management User friendly GUI Hardware configuration, allocation and monitoring -
Phoeßus Inventory Production Processing server Processing server Execution Events Processing
center Event manager Workflow engine Administration & supervision Job management system -
Phoeßus Inventory Production Processing server Processing server Execution Events Processing
center Event manager Workflow engine Administration & supervision Job management system Monitor and Command of the Data Production Centre (startup/shutdown, etc. Monitor and Command of the hardware components status (nodes of the clust On Line Help of the Data Production Centre No human intervention is required in nominal operation Administration & supervision -
Phoeßus Inventory Production Processing server Processing server Execution Events Processing
center Event manager Workflow engine Administration & supervision Job management system Detects processing events described in an XML configuration file - data events, time events, stream events, web services events (WPS), user events Event manager -
Phoeßus Inventory Production Processing server Processing server Execution Events Processing
center Event manager Workflow engine Administration & supervision Job management system Generates & manages workplan automatically or manually (MMI) Orchestrates & parallelizes the execution according to execution events (errors, crash) and operator orders (stop, resume, cancel, change priority, replan) Workflow engine -
Phoeßus Inventory Production Processing server Processing server Execution Events Processing
center Event manager Workflow engine Administration & supervision Job management system Processes the parallelization level on run-time Supports both CNES-LAI and ESA-JobOrder interfaces, Monitors and controls the execution of the software executable delegated to Phoebus-JobManagement component. Processing server Processing server -
Phoeßus Inventory Production Processing server Processing server Execution Events Processing
center Event manager Workflow engine Administration & supervision Job management system Distributes the software executable onto the cluster of processing servers on an optimized way. Support 3 different types of distributed applications (Pléiades proprietary, DRMAA vA API (e.g. Torque/Maui), Cascading Hadoop) Job management system -
Performance and scalability IPU-Pleiades Center (hosted in SpotImage premises) -
500 images/day generated thanks to cluster of 52 servers (octo-core) - Raw images in case of urgent Defense needs) are delivered in less than 7mn - High level corrected images are delivered in less than 25mn -
WPS a WPS a Web application Orfeo Toolbox mapshup http://mapshup.info
http://constellation-sdi.org http://orfeo-toolbox.org -
WPS a WPS a Web application Orfeo Toolbox mapshup http://mapshup.info
http://constellation-sdi.org http://orfeo-toolbox.org -
WPS a WPS a Web application 1 1 - DescribeProcess
request for "Classification" Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org -
WPS a WPS a Web application 1 1 - DescribeProcess
request for "Classification" Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org -
WPS a WPS a Web application 1 1 - DescribeProcess
request for "Classification" Classification process description 2 2 - Set up MMI from process description Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org -
WPS a WPS a Web application 1 1 - DescribeProcess
request for "Classification" Classification process description 2 2 - Set up MMI from process description Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org -
WPS a WPS a Web application 1 1 - DescribeProcess
request for "Classification" Classification process description 2 2 - Set up MMI from process description + Image Well known areas 3 3 - Execute an asynchronous "Classification" request Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org -
WPS a WPS a Web application 1 1 - DescribeProcess
request for "Classification" Classification process description 2 2 - Set up MMI from process description + Image Well known areas 3 3 - Execute an asynchronous "Classification" request Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org -
WPS a WPS a Web application 1 1 - DescribeProcess
request for "Classification" Classification process description 2 2 - Set up MMI from process description + Image Well known areas 3 3 - Execute an asynchronous "Classification" request Land Cover 4 4 - Display result retrieved as a WMS layer Orfeo Toolbox mapshup http://mapshup.info http://constellation-sdi.org http://orfeo-toolbox.org -
AMMA CYCLOPES GEOLAND GLOBCOVER PARASOL POLDER Land cover Soil moisture
Temperature Reflectance Vegetation -
OWS-10 OGC testbed Orthorectifying images hosted by a cloud infrastructure
using WPS standard Planned activities -
WMS Web client EU Cloud WPS Orthorectification CNES - Orfeo
Toobox WMS WPS Assess Quality Improve Quality Astrium Pléiades sample data Sentinel 2 simulated (?)