Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Jupyter's Phenomenal Growth

Jupyter's Phenomenal Growth

Presentation Title

Jupyter's Phenomenal Growth: What's Next for San Diego

Abstract

Over the past five years, the Jupyter notebook has become a "de facto" standard in Data Science, Science, and Education. Project Jupyter received the 2017 ACM Software System Award for Jupyter, a broad collaboration that develops open source tools for interactive computing, with a language-agnostic design.

I'll share a brief look at San Diego's history with Project Jupyter and its growth locally. I will share some updates from our annual Jupyter team meeting (which occurs the week before the meetup) especially about JupyterHub, Binder, JupyterLab, and visualizations. I'll wrap up with a bit about Python, R and Julia's use with Jupyter and open up the discussion for questions.

Carol Willing

March 20, 2019
Tweet

More Decks by Carol Willing

Other Decks in Technology

Transcript


  1. Jupyter Team
    Carol Willing
    SD Meetup
    March 20, 2019
    @WillingCarol
    Jupyter's
    Phenomenal Growth:
    What's next

    View full-size slide

  2. Tools and
    Community
    @WillingCarol

    View full-size slide

  3. Data Science & Science
    PyData
    AI
    Machine Learning
    Visualization
    Fernando Perez
    Creator, IPython & Jupyter

    View full-size slide

  4. Project Jupyter Mission

    View full-size slide

  5. Learning and computational ideas
    Usability

    Reproducibility

    Collaboration
    Prediction

    Recommendation

    Classification

    View full-size slide

  6. Jupyter
    Notebook
    A Jupyter Notebook document with a visualization of measles data.

    View full-size slide

  7. Anatomy of
    a notebook
    http://adamrule.com/files/papers/chi_2018_computational_notebooks_final_web.pdf
    https://blog.jupyter.org/we-analyzed-1-million-jupyter-notebooks-now-you-can-too-
    guest-post-8116a964b536
    Structure and design
    • Adam Rule et al.
    • analyzed 1 million
    notebooks
    • design opportunities

    View full-size slide

  8. Jupyter
    ‣ Growth
    ‣ ACM Award
    ‣ Industry adoption
    ‣ Creative uses
    ‣ Open Source Book

    View full-size slide

  9. Notebooks
    and
    Workflows
    @WillingCarol

    View full-size slide

  10. JupyterLab
    Try it on Binder.
    next-generation,

    web-based,

    extensible

    user interface

    for Jupyter

    View full-size slide

  11. Introduction to
    Mechanical
    Vibration
    (Jason Moore &
    Kenneth Lyons)
    http://www.moorepants.info/blog/introducing-resonance.html

    View full-size slide

  12. nteract
    ReactJS front end

    View full-size slide

  13. nteract
    Enterprise data workflows

    View full-size slide

  14. Cloud and
    Groups
    @WillingCarol

    View full-size slide

  15. zero-to-jupyterhub.readthedocs.io

    View full-size slide

  16. @WillingCarol
    JupyterHub: Deploy with Kubernetes
    https://zero-to-jupyterhub.readthedocs.io/en/latest/

    View full-size slide

  17. Architecture authenticators, spawners,
    services

    View full-size slide


  18. Digital Ocean

    Jetstream

    Google Cloud

    AWS

    Your Ubuntu 18.04 server
    @WillingCarol

    View full-size slide

  19. Documentation
    @WillingCarol
    the-littlest-jupyterhub.readthedocs.io

    View full-size slide

  20. https://blog.jupyter.org/binder-2-0-a-tech-guide-2017-fd40515a3a84
    https://elifesciences.org/labs/8653a61d/introducing-binder-2-0-share-your-
    interactive-research-environment
    https://www.nature.com/articles/d41586-018-01322-9
    mybinder.org

    View full-size slide

  21. Build your own BinderHub
    https://binderhub.readthedocs.io/en/latest/

    View full-size slide

  22. BinderHub Architecture

    View full-size slide

  23. repo2docker
    https://repo2docker.readthedocs.io

    View full-size slide

  24. Interactivity
    and
    Visualization
    @WillingCarol

    View full-size slide

  25. ‣ High level: WebAssembly and Javascript
    ‣ Low level: Rust
    ‣ wasm-bindgen wasm-pack
    ‣ Install using pip
    Improving Jupyter widgets and
    using with Python

    View full-size slide

  26. https://youtu.be/5dl_m_6T2bU?t=7

    View full-size slide

  27. https://github.com/data-
    exp-lab/rust-yt-tools/
    npm
    package @data-
    exp-lab/yt-tools
    Irber Junior LC.
    Oxidizing Python:
    writing extensions in
    Rust [version 1; not
    peer
    reviewed]. F1000Rese
    arch 2018, 7(ISCB
    Comm J):955 (poster)
    (https://doi.org/
    10.7490/
    f1000research.
    1115726.1)
    https://github.com/
    munkm/widgyts

    View full-size slide

  28. ipyvolume
    https://
    towardsdatascience.com/
    multivolume-rendering-in-
    jupyter-with-ipyvolume-
    cross-language-3d-
    visualization-64389047634a

    View full-size slide

  29. https://mybinder.org/v2/gh/willingc/pydy-tutorial-human-standing/master
    https://github.com/
    pydy/pydy-tutorial-
    human-standing
    Animation

    View full-size slide

  30. https://mybinder.org/v2/gh/willingc/pydy-tutorial-human-standing/master
    https://github.com/pydy/pydy-tutorial-human-standing

    View full-size slide

  31. San Diego
    @WillingCarol

    View full-size slide

  32. https://zonca.github.io/
    @WillingCarol

    View full-size slide

  33. http://genepattern-notebook.org/
    @WillingCarol

    View full-size slide

  34. https://www.westhealth.org/
    resource/data-science-overview/
    @WillingCarol

    View full-size slide

  35. https://tinyletter.com/TrackingJupyter
    @WillingCarol

    View full-size slide

  36. https://jupyter4edu.github.io/jupyter-edu-book/
    @WillingCarol

    View full-size slide

  37. Matplotlib documentation

    Carol Willing papers and photos

    Project Jupyter

    nteract project

    Python website

    Fernando Perez website

    ipyvolume project

    yt project and Madickin

    View full-size slide