Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Catalog-Driven Workflows

Avatar for Rich Signell Rich Signell
July 13, 2016
0
110

Catalog-Driven Workflows

SciPy 2016 Lightning Talk

Avatar for Rich Signell

Rich Signell

July 13, 2016
Tweet

More Decks by Rich Signell

See All by Rich Signell
Pangeo: A Scalable, Flexible Framework for Geoprocessing
Avatar for Rich Signell rsignell
1
120
Handling Ocean/Met/Hydro Model Output
Avatar for Rich Signell rsignell
0
83
Reducing Data Friction in Ocean Science
Avatar for Rich Signell rsignell
0
110
A Standards-Based Portal for Oceanographic Models and Data
Avatar for Rich Signell rsignell
0
85
A Standardized Framework for Reproducible Model Skill Assessment
Avatar for Rich Signell rsignell
0
93
Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and Visualizing Met-Ocean Data
Avatar for Rich Signell rsignell
1
140
Toward OGC Support for the Next Generation of Climate and Forecast Models
Avatar for Rich Signell rsignell
0
130
Catalog-driven, Reproducible Workflows for Ocean Science
Avatar for Rich Signell rsignell
0
96
Catalog-driven workflows using CSW
Avatar for Rich Signell rsignell
0
140

Featured

See All Featured
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
332
24k
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
6.8k
Visualization
Avatar for Eitan Lees eitanlees
147
16k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
34
6k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
87
4.8k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
53
8.9k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
231
18k
The Language of Interfaces
Avatar for Des Traynor destraynor
160
25k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.4k
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
18
1.1k

Transcript

  1. Catalog-driven Workflows Rich Signell , USGS, Woods Hole, MA, USA

    Filipe Fernandes, SECOORA, Salvador, Brazil Kyle Wilcox, Axiom Data Science, Wickford, RI, USA SciPy 2016 2016-07-13 Lightning Talk

  2. 2015 Boston Light Swim, Aug 15, 7:00am since 1907, 8

    miles, no wet suit How cold will the water be?

  3. NECOFS Massbay Forecast

  4. US Integrated Ocean Observing System (IOOS® ) IOOS® Plan defines:

    • Global Component • Coastal Component  17 Federal Agencies  11 Regional Associations

  5. IOOS Core Principles • Adopt open standards & practices •

    Avoid customer-specific stovepipes • Standardized access services implemented at data providers 5 Customer Web access service Data Provider Observations Models

  6. pycsw for providing CSW services

  7. OWSLib for accessing OGC Services

  8. Catalog-Driven Notebook

  9. None
  10. None

  11. Final Result

  12. Bias-Corrected Forecast

  13. Check it out on Github/Binder