Containers: Practices, Problems, and Possiblilities

Containers: Practices, Problems, and Possiblilities

WOSSS19 presentation

C8eedb2bca5728f0f73294b5b5a0222e?s=128

Carol Willing

April 25, 2019
Tweet

Transcript

  1. 
 Jupyter Team Carol Willing WOSSS19 April 25, 2019 @WillingCarol

    Containers Practices, Problems, and Possibilities
  2. Jupyter Steering Council Core Developer JupyterHub, BinderHub, mybinder.org Python Steering

    Council Core Developer PSF Fellow Carol Willing
  3. Jupyter ‣ Growth ‣ ACM Award ‣ Industry adoption ‣

    Creative uses ‣ Open Source Book
  4. Project Jupyter Containers 2014-Present @WillingCarol

  5. Evolution • jupyter/docker-stacks: Docker containers for common user environments •

    JupyterHub: Docker containers for ease of deployment and to provide isolated environments for users • Zero to JupyterHub with Kubernetes: Use Kubernetes to scale JupyterHub from a single class to a large scale MOOCs • BinderHub and mybinder.org: Kubernetes and Docker containers used to offer a service @WillingCarol • Environment • Deployment • Scaling • Service
  6. zero-to-jupyterhub.readthedocs.io

  7. https://blog.jupyter.org/binder-2-0-a-tech-guide-2017-fd40515a3a84 https://elifesciences.org/labs/8653a61d/introducing-binder-2-0-share-your- interactive-research-environment https://www.nature.com/articles/d41586-018-01322-9 mybinder.org

  8. Practices @WillingCarol

  9. Understand the use case before selecting a container solution. @WillingCarol

    Practices
  10. Converge on solutions for deployment and share openly. @WillingCarol Practices

  11. https://zonca.github.io/ @WillingCarol Practices

  12. Use standard tools. Don't build software from scratch when standard

    tools are available. @WillingCarol Practices
  13. When running a service, apply Site Reliability best practices. Document

    processes and perform blameless post- mortems. @WillingCarol Practices
  14. Problems @WillingCarol

  15. Learning Curve and Software Skills Investment @WillingCarol Problems

  16. Data and Access Controls @WillingCarol Problems

  17. Scaling @WillingCarol Problems

  18. Vendor Lock-in @WillingCarol Problems

  19. Possibilities @WillingCarol

  20. Tailored Workflows @WillingCarol Possibilities

  21. http://genepattern-notebook.org/ @WillingCarol

  22. nteract Enterprise data workflows

  23. Accessible Science @WillingCarol Possibilities

  24. Introduction to Mechanical Vibration (Jason Moore & Kenneth Lyons) http://www.moorepants.info/blog/introducing-resonance.html

  25. https://jupyter4edu.github.io/jupyter-edu-book/ @WillingCarol

  26. Visualization and WebAssembly @WillingCarol Possibilities

  27. https://github.com/data- exp-lab/rust-yt-tools/ npm package @data- exp-lab/yt-tools Irber Junior LC. Oxidizing

    Python: writing extensions in Rust [version 1; not peer reviewed]. F1000Rese arch 2018, 7(ISCB Comm J):955 (poster) (https://doi.org/ 10.7490/ f1000research. 1115726.1) https://github.com/ munkm/widgyts
  28. ipyvolume https:// towardsdatascience.com/ multivolume-rendering-in- jupyter-with-ipyvolume- cross-language-3d- visualization-64389047634a

  29. None
  30. None
  31. Matplotlib documentation Carol Willing papers and photos Project Jupyter nteract

    project Python website Fernando Perez website ipyvolume project yt project and Madickin Munk Jason Moore
  32. 
 Jupyter Team Carol Willing WOSSS19 April 25, 2019 @WillingCarol

    Containers Practices, Problems, and Possibilities