Cool Data Stuff at USGS

Presentation to the US Integrated Ocean Observing System (US-IOOS) Data Management and Communications (DMAC) Steering Team

Transcript

1. U.S. Department of the Interior U.S. Geological Survey Cool data stuff at USGS Rich Signell USGS Woods Hole, MA IOOS DMAC Steering Team Meeting Washington DC, Feb 27-28, 2013
2. USGS Mission  To provide geologic, topographic, and hydrologic information that contributes to the wise management of the Nation's natural resources and that promotes the health, safety, and well- being of the people  Slogan: “Science for a Changing World”
3. USGS Mission Areas alligned in 2010 with science themes  Climate and Land Use Change  Water  Ecosystems  Energy and Minerals  Environmental Health  Natural Hazards  Core Science Systems
4. USGS is a small agency  USGS $1.1B (FY12)  NOAA $5.5B, NASA $18B, USGOV $3,670B  USGS is $0.03 on a $100 dollar bill Total: $3,670B nationalpriorities.org
5. R&D Budget by Agency Source: http://www.aaas.org/spp/rd/fy2013/total13c.pdf MIL: $79.1B NASA: $9.1B NSF: $5.5B NOAA: $0.6B USGS: $0.6B EPA: $0.6B -------------- Total: $144B
6. Mission Area: Climate and Land Use Change
12. Katama Bay Animation
13. ESRI RESTful Image Web Service
14. Same services accessed by ESRI client
15. The National Elevation Dataset (NED)
16. 1/9-arc-second = ~ 3 m 1/3-arc-second = ~ 10 m 1-arc-second = ~ 30 m
17. NED is updated every 2 months
18. NED 1/9 second, Falmouth, MA 81 Queen St, 4.1m above MSL
19. In Aug 2012, NED entered the ocean… Adding bathy to the NED is a collaboration between NOAA/NGDC, USGS/CMG and USACE
20. Mission Area: Water
21. Old School
22. New School
23. New School
25. CIDA GDP Climate Downscaling Tool Built on: THREDDS OPeNDAP WCS WMS CSW WPS
26. Python & Matlab interfaces to GDP
27. CIDA Code on GitHub
28. Mission Area: Ecosystem Science
29. Mission Area: Energy and Minerals
30. Mission Area: Environmental Health Programs
31. Mission Area: Natural Hazards
32. Did You Feel It? Crowdsourcing
33. Superstorm Sandy Erosion Forecast USGS Coastal and Marine Program, St. Petersburg
35. 228 surge sensors deployed by water offices in each state, 8 realtime, 950 verified high water marks Led by Brian McCallum, USGS Georgia Water Science Center
37. Mission Area: Core Science Systems
39. Community for Data Integration (CDI) $500K annually for proposals
40. Scientific Analysis tools at USGS  Majority of scientists use ArcGIS as their primary scientific analysis and visualation tool  ArcGIS 10 uses Python as it’s scripting and interface language  Use of Python allows ArcGIS users to utilize 100s of community packages  In 2012, USGS bought an Enthought Python Distribution (EPD) site license to facilitate interoperability of science workflows
41. OPeNDAP UGRID → ArcGIS TIN New 10.1 Python Toolbox import netCDF4 import arcpy netCDF4.Dataset(URL) arcpy.LandXMLToTin_3d(.. arcpy.TinRaster_3d(…
42. Assessing a 30 year ocean hindcast in the Gulf of Maine  One 15 TB dataset from 4D ocean model served via the THREDDS data server at UMASS/SMAST (commissioned by Mass CZM for Mass Ocean Plan)  600 time series datasets from 3 different THREDDS catalogs (USGS, NOAA/NMFS, WHOI) in Woods Hole
43. IOOS Model Data Interoperability Design ROMS POM WW3 WRF ECOM NcML NcML NcML NcML NcML Common Data Model OPeNDAP+CF WCS NetCDF Subset THREDDS Data Server Standardized (CF) Virtual Datasets Nonstandard Model Output Files (distributed) Web Services Matlab Panoply IDV ERDDAP Clients NetCDF -Java Library or Service NcML, NetCDF-Java, Common Data Model and THREDDS Data Server built and supported by Unidata under NSF-support WMS ncISO ArcGIS NetCDF4 -Python FVCOM Python EDC ERDDAP NetCDF-Java SOS GeoPortal Server GeoNetwork GI-CAT Gridded data, time series, point, profile, trajectory,swath
44. GI-CAT catalog broker service
49. Kellndorfer and Walker, 2012 Woods Hole Research Center NASA SRTM USGS NED USGS NLDC + Forest Service Ground Truth
51. Conclusions  USGS & DMAC are on same services bandwagon (OGC, OPeNDAP/CF + ESRI + Custom)  USGS has a lot of cool data and products  But USGS should not be an organizing principle for data – we want to facilitate cross- agency, cross- sector, and cross-discipline mashups  Keep USGS CDI, NOAA DMIT, IOOS DMAC, CMSP (now Ocean Planning), OGC, ESIP circles overlapped  Keep building out the services, service-consuming web apps, science work flows, standards-based tools in Matlab, Python, R, ArcGIS and listening to scientists & developers