Pangeo European Meeting 2019 - A history of science on the cloud at the Met Office

The Informatics Lab is a technology, science and design research group at the Met Office. For the last four years we've been exploring, among other things, how we can do more science using the power of cloud computing. Using tools such as Jupyter, Dask and Kubernetes we've built a number of prototypes of cloud based scientific platforms starting with our JADE project through to current implementations of Pangeo. In this session we will cover how we evolved these systems, produced tools like dask-kubernetes and the Pangeo helm chart, helped build a community, and pushed our science and the Met Office forward.

Transcript

1. JACOB TOMLINSON TECHNOLOGIST PETER KILLICK TECHNOLOGIST
2. ABOUT US
3. THE OFFICE
4. THE LAB
5. HISTORY OF SCIENCE ON THE CLOUD
6. 3D VISUALISATION
10. JADE JUPYTER AND DASK ENVIRONMENT
11. A TYPICAL WORKFLOW
12. Iris
13. IRIS AND DASK
14. Iris
15. PANGEO PROJECT AND COMMUNITY
17. Rebuilt JADE as Pangeo helm chart
18. And many more…
20. FUTURE WORK
22. Forecasters
24. THE ENVIRONMENTAL FUTURES & BIG DATA IMPACT LAB
26. CLOUD PANGEO and quick demo...
29. DASK KUBERNETES
30. SHARED VS INDIVIDUAL CLUSTERS
31. JADE Dask (Aug 2016) JASMIN Dask (Aug 2017) Daskernetes (Jan 2018) Dask Kubernetes (Mar 2018)
32. JADE Dask (Aug 2016) JASMIN Dask (Aug 2017) Daskernetes (Jan 2018) Dask Kubernetes (Mar 2018)
33. JADE Dask (Aug 2016) JASMIN Dask (Aug 2017) Daskernetes (Jan 2018) Dask Kubernetes (Mar 2018)
34. JADE Dask (Aug 2016) JASMIN Dask (Aug 2017) Daskernetes (Jan 2018) Dask Kubernetes (Mar 2018)
35. SERVERLESS PANGEO
39. CaaS
41. FUTURE WORK
43. ANY QUESTIONS? Anything else? Get in touch: www.informaticslab.co.uk / @informatics_lab / hello@informaticslab.co.uk