Pangeo at Ocean Science Meeting 2022

Slides for the Presentation by Deepak Cherian and Julius Busecke at the Ocean Sciences Meeting 2022

Video Link: https://youtu.be/r82-vVCOuwQ

Transcript

1. Deepak Cherian + Julius Busecke Open Sesame! Open your science with Pangeo
2. Cloud-native 
 analysis Machine learning Crunching \Bigg datasets Analysis-Ready 
 Cloud Optimized Data pipelines Teaching earth 
 system data 
 science Cloud-analysis 
 platform Open source 
 scienti fi c 
 software Discourse 
 forum Data catalogs Dask Xarray Zarr
3. 2010-2016 medium data Laptop/HPC 
 ~ 100 sims = 12 TB Reinventing many wheels 2017-2019 smol data laptop 
 ~GB 5 moorings! 
 2019- smol & big data MBs & ~TBs 
 laptop/server/HPC/cloud obs / models 

4. Before: for …: … After: 
 # groupby? (binning) 
 # rolling? (moving window) 
 # … 🤔 2017-2019 smol data laptop 
 ~GB 5 moorings! 

5. 2019- smol & big data 
 laptop/server/HPC/cloud obs / models 

6. = community
7. = peer - to - peer 
 learning
8. Cloud-native 
 analysis Machine learning Crunching \Bigg datasets Analysis-Ready 
 Cloud Optimized Data pipelines Teaching earth 
 system data 
 science Cloud analysis 
 platform Open source 
 scienti fi c 
 software Discourse 
 forum = peer - to - peer 
 learning Data catalogs Dask Xarray Zarr
9. Citations in blue Community in blue
10. Custom Code A common language Project-speci fi c xskillscore … … Domain - speci fi c
11. Engage
12. Custom Code A common language Project-speci fi c xskillscore … … Domain - speci fi c
13. Custom Code A common language Project-speci fi c xskillscore … … Domain - speci fi c Project-speci fi c A new kind of science discourse.pangeo.io Github Twitter A common language shared Jupyter notebooks Domain - speci fi c
14. 😍
16. An a lyzing Pet a byte sc a le clim a te d a t a in your browser with P a ngeo No Supercomputer, no problem! Custom Analysis applied to each model and member
17. What we want to do
18. What we want to do 💡 Have an idea
19. What we want to do Write some code
20. What we want to do Rock some science
21. What we want to do Rock some science
22. What we have to do instead Download Files
23. What we have to do instead FTP / OPeNDAP / etc. Download Files
24. MB 😀 FTP / OPeNDAP / etc.
25. GB 😐 FTP / OPeNDAP / etc.
26. TB 😖 FTP / OPeNDAP / etc.
27. PB 😱 FTP / OPeNDAP / etc.
28. Time to science?
29. Di ff erent dimension names in the CMIP data. 
 
 Not quite analysis -ready No! Time to clean data!
30. 🤔 💡 No! Time to clean data!
31. 🤔 💡 Competition for brain power
32. 🤔 Isn’t there a better way?
33. There is! + Analysis Ready Data in the cloud Crowd-Sourced Data Cleaning 
 (peer-to-peer learning)
34. There is! + Analysis Ready Data in the cloud Crowd-Sourced Data Cleaning 
 (peer-to-peer learning) Less data wrangling, more 💡 =
35. Demo
36. Why the cloud?
37. Why the cloud? Fast
38. Why the cloud? Fast
39. Why the cloud? Open
40. Why the cloud? Open
41. Why the cloud? Collaborative + Reproducible science
42. Why the cloud? Collaborative + Reproducible science
43. Why the cloud? Low entry barrier to try new things!
44. Why the cloud? Low entry barrier to try new things!
45. = peer - to - peer 
 learning Why the cloud?
46. What’s next? Join the community! discourse.pangeo.io (forum) gallery.pangeo.io (science examples) projectpythia.org (open science resources) Github (go where the code lives) Twitter (great for quick questions) Weekly meetings
47. Dont be afraid to ask and share Nobody is going to shame your code. We all started somewhere! 🤗
49. Start small
50. Start small Start your next project with pangeo tools
51. Start small Start your next project with pangeo tools Stay here and and dig into some CMIP6 data if you like
52. Start small Start your next project with pangeo tools Stay here and and dig into some CMIP6 data if you like
56. Logos
57. Logos