Jupyter's Phenomenal Growth

Presentation Title

Jupyter's Phenomenal Growth: What's Next for San Diego

Abstract

Over the past five years, the Jupyter notebook has become a "de facto" standard in Data Science, Science, and Education. Project Jupyter received the 2017 ACM Software System Award for Jupyter, a broad collaboration that develops open source tools for interactive computing, with a language-agnostic design.

I'll share a brief look at San Diego's history with Project Jupyter and its growth locally. I will share some updates from our annual Jupyter team meeting (which occurs the week before the meetup) especially about JupyterHub, Binder, JupyterLab, and visualizations. I'll wrap up with a bit about Python, R and Julia's use with Jupyter and open up the discussion for questions.

Transcript

1. 

   Jupyter Team
   Carol Willing
   SD Meetup
   March 20, 2019
   @WillingCarol
   Jupyter's
   Phenomenal Growth:
   What's next
   

   View Slide

2. View Slide

3. View Slide

4. Tools and
   Community
   @WillingCarol
   

   View Slide

5. Data Science & Science
   PyData
   AI
   Machine Learning
   Visualization
   Fernando Perez
   Creator, IPython & Jupyter
   

   View Slide

6. Project Jupyter Mission
   

   View Slide

7. Learning and computational ideas
   Usability
   
   Reproducibility
   
   Collaboration
   Prediction
   
   Recommendation
   
   Classification
   

   View Slide

8. Jupyter
   Notebook
   A Jupyter Notebook document with a visualization of measles data.
   

   View Slide

9. Anatomy of
   a notebook
   http://adamrule.com/files/papers/chi_2018_computational_notebooks_final_web.pdf
   https://blog.jupyter.org/we-analyzed-1-million-jupyter-notebooks-now-you-can-too-
   guest-post-8116a964b536
   Structure and design
   • Adam Rule et al.
   • analyzed 1 million
   notebooks
   • design opportunities
   

   View Slide

10. jupyter.org
    

    View Slide

11. Jupyter
    ‣ Growth
    ‣ ACM Award
    ‣ Industry adoption
    ‣ Creative uses
    ‣ Open Source Book
    

    View Slide

12. Notebooks
    and
    Workflows
    @WillingCarol
    

    View Slide

13. JupyterLab
    Try it on Binder.
    next-generation,
    
    web-based,
    
    extensible
    
    user interface
    
    for Jupyter
    

    View Slide

14. Introduction to
    Mechanical
    Vibration
    (Jason Moore &
    Kenneth Lyons)
    http://www.moorepants.info/blog/introducing-resonance.html
    

    View Slide

15. nteract
    ReactJS front end
    

    View Slide

16. nteract
    Enterprise data workflows
    

    View Slide

17. Cloud and
    Groups
    @WillingCarol
    

    View Slide

18. zero-to-jupyterhub.readthedocs.io
    

    View Slide

19. View Slide

20. @WillingCarol
    JupyterHub: Deploy with Kubernetes
    https://zero-to-jupyterhub.readthedocs.io/en/latest/
    

    View Slide

21. Architecture authenticators, spawners,
    services
    

    View Slide

22. 

    Digital Ocean
    
    Jetstream
    
    Google Cloud
    
    AWS
    
    Your Ubuntu 18.04 server
    @WillingCarol
    

    View Slide

23. Documentation
    @WillingCarol
    the-littlest-jupyterhub.readthedocs.io
    

    View Slide

24. https://blog.jupyter.org/binder-2-0-a-tech-guide-2017-fd40515a3a84
    https://elifesciences.org/labs/8653a61d/introducing-binder-2-0-share-your-
    interactive-research-environment
    https://www.nature.com/articles/d41586-018-01322-9
    mybinder.org
    

    View Slide

25. Build your own BinderHub
    https://binderhub.readthedocs.io/en/latest/
    

    View Slide

26. BinderHub Architecture
    

    View Slide

27. repo2docker
    https://repo2docker.readthedocs.io
    

    View Slide

28. View Slide

29. Interactivity
    and
    Visualization
    @WillingCarol
    

    View Slide

30. ‣ High level: WebAssembly and Javascript
    ‣ Low level: Rust
    ‣ wasm-bindgen wasm-pack
    ‣ Install using pip
    Improving Jupyter widgets and
    using with Python
    

    View Slide

31. https://youtu.be/5dl_m_6T2bU?t=7
    

    View Slide

32. https://github.com/data-
    exp-lab/rust-yt-tools/
    npm
    package @data-
    exp-lab/yt-tools
    Irber Junior LC.
    Oxidizing Python:
    writing extensions in
    Rust [version 1; not
    peer
    reviewed]. F1000Rese
    arch 2018, 7(ISCB
    Comm J):955 (poster)
    (https://doi.org/
    10.7490/
    f1000research.
    1115726.1)
    https://github.com/
    munkm/widgyts
    

    View Slide

33. View Slide

34. ipyvolume
    https://
    towardsdatascience.com/
    multivolume-rendering-in-
    jupyter-with-ipyvolume-
    cross-language-3d-
    visualization-64389047634a
    

    View Slide

35. View Slide

36. https://mybinder.org/v2/gh/willingc/pydy-tutorial-human-standing/master
    https://github.com/
    pydy/pydy-tutorial-
    human-standing
    Animation
    

    View Slide

37. https://mybinder.org/v2/gh/willingc/pydy-tutorial-human-standing/master
    https://github.com/pydy/pydy-tutorial-human-standing
    

    View Slide

38. San Diego
    @WillingCarol
    

    View Slide

39. https://zonca.github.io/
    @WillingCarol
    

    View Slide

40. http://genepattern-notebook.org/
    @WillingCarol
    

    View Slide

41. https://www.westhealth.org/
    resource/data-science-overview/
    @WillingCarol
    

    View Slide

42. https://tinyletter.com/TrackingJupyter
    @WillingCarol
    

    View Slide

43. https://jupyter4edu.github.io/jupyter-edu-book/
    @WillingCarol
    

    View Slide

44. View Slide

45. Matplotlib documentation
    
    Carol Willing papers and photos
    
    Project Jupyter
    
    nteract project
    
    Python website
    
    Fernando Perez website
    
    ipyvolume project
    
    yt project and Madickin
    
    

    View Slide

46. bb
    

    View Slide