Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Catalog-Driven Workflows

Avatar for Rich Signell Rich Signell
July 13, 2016
0
110

Catalog-Driven Workflows

SciPy 2016 Lightning Talk

Avatar for Rich Signell

Rich Signell

July 13, 2016
Tweet

More Decks by Rich Signell

See All by Rich Signell
Pangeo: A Scalable, Flexible Framework for Geoprocessing
Avatar for Rich Signell rsignell
1
130
Handling Ocean/Met/Hydro Model Output
Avatar for Rich Signell rsignell
0
87
Reducing Data Friction in Ocean Science
Avatar for Rich Signell rsignell
0
120
A Standards-Based Portal for Oceanographic Models and Data
Avatar for Rich Signell rsignell
0
98
A Standardized Framework for Reproducible Model Skill Assessment
Avatar for Rich Signell rsignell
0
110
Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and Visualizing Met-Ocean Data
Avatar for Rich Signell rsignell
1
160
Toward OGC Support for the Next Generation of Climate and Forecast Models
Avatar for Rich Signell rsignell
0
140
Catalog-driven, Reproducible Workflows for Ocean Science
Avatar for Rich Signell rsignell
0
110
Catalog-driven workflows using CSW
Avatar for Rich Signell rsignell
0
150

Featured

See All Featured
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4.2k
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
110
It's Worth the Effort
Avatar for 3n 3n
188
29k
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
5
35k
Test your architecture with Archunit
Avatar for Yoan thirion
1
2.1k
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
0
32k
Color Theory Basics | Prateek | Gurzu
Avatar for Gurzu gurzu
0
200
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
182
10k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
650
Done Done
Avatar for chrislema chrislema
186
16k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1032
470k

Transcript

  1. Catalog-driven Workflows Rich Signell , USGS, Woods Hole, MA, USA

    Filipe Fernandes, SECOORA, Salvador, Brazil Kyle Wilcox, Axiom Data Science, Wickford, RI, USA SciPy 2016 2016-07-13 Lightning Talk

  2. 2015 Boston Light Swim, Aug 15, 7:00am since 1907, 8

    miles, no wet suit How cold will the water be?

  3. NECOFS Massbay Forecast

  4. US Integrated Ocean Observing System (IOOS® ) IOOS® Plan defines:

    • Global Component • Coastal Component  17 Federal Agencies  11 Regional Associations

  5. IOOS Core Principles • Adopt open standards & practices •

    Avoid customer-specific stovepipes • Standardized access services implemented at data providers 5 Customer Web access service Data Provider Observations Models

  6. pycsw for providing CSW services

  7. OWSLib for accessing OGC Services

  8. Catalog-Driven Notebook

  9. None
  10. None

  11. Final Result

  12. Bias-Corrected Forecast

  13. Check it out on Github/Binder