Getting Started with JupyterHub, Binder, and JupyterLab

A workshop at PyCon India 2018

Transcript

1. 
 Getting Started with JupyterHub, Binder, and JupyterLab Carol Willing, Project Jupyter Binder Team JupyterHub Team JupyterLab Team @WillingCarol Oct. 5, 2018
2. Hi and Welcome Steering Council, Project Jupyter Core Developer, Project Jupyter Software Engineer, Cal Poly SLO Fellow, Python Software Foundation Core Developer, CPython Geek in Residence, Fab Lab San Diego Carol Willing @willingcarol
3. 1. Overview 1.1. Interactive Discussion and Hands On 1.2. Schedule: 3 hours (15 minute break) 2. Jupyter Notebooks 2.1. What is a notebook? 2.2. Where are we today? 3. JupyterLab - The Next Generation 3.1. Building blocks 3.2. State of JupyterLab 3.3. A Whirlwind Tour @WillingCarol Agenda
4. 4. JupyterHub 4.1. The Littlest JupyterHub 4.2. Zero to JupyterHub on Kubernetes 5. BinderHub and mybinder.org 6. Wrap up 6.1. Resources 6.2. Questions @WillingCarol Agenda
5. 
 The Jupyter Notebook
6. Learning and computational ideas Usability Reproducibility Collaboration Prediction Recommendation Classification
7. 
 Jupyter Notebook • Interactive, browser-based computing environment • Exploratory data science, ML, visualization, analysis, stats • Reproducible document format: • Code • Narrative text (markdown) • Equations (LaTeX) • Images, visualizations • Over 50 programming languages • Everything open-source (BSD license) Interactive, Exploratory, Reproducible
8. 
 Jupyter Notebook A Jupyter Notebook document with a visualization of measles data.
9. 
 Project Jupyter: Where are we today?
10. 
 Millions of Notebooks https://github.com/trending/jupyter-notebook
11. 
 Millions of Users https://github.com/jupyter/design/blob/master/surveys/2015-notebook-ux/analysis/report_dashboard.ipynb
12. 
 Enabling Reproducible Science https://losc.ligo.org/about/
13. 
 Live Code on Binder https://beta.mybinder.org/v2/gh/minrk/ligo-binder/master?filepath=index.ipynb https://losc.ligo.org/tutorials/ LIGO Binder
14. 
 Enabling Open Data Journalism
15. 
 Authoring Interactive Books https://www.oreilly.com/ideas/jupyter-at-oreilly O’Reilly Atlas authoring platform incorporating live code
16. 
 Classic Jupyter: More Than Just Notebooks
17. 1. Overview 1.1. Interactive Discussion and Hands On 1.2. Schedule: 3 hours (15 minute break) 2. Jupyter Notebooks 2.1. What is a notebook? 2.2. Where are we today? 3. JupyterLab - The Next Generation 3.1. Building blocks 3.2. State of JupyterLab 3.3. A Whirlwind Tour @WillingCarol Agenda
18. 
 Introducing JupyterLab
19. 

 JupyterLab: The Evolution of the Jupyter Notebook The JupyterLab Team Chris Colbert, Jupyter Steven Silvester, Quansight Afshin Darian, Jupyter Ian Rose, Berkeley Jason Grout, Bloomberg Brian Granger, Cal Poly Jessica Forde, Jupyter Grant Nestor, Cal Poly Cameron Oelsen, Cal Poly Fernando Perez, LBNL/Berkeley Cal Poly Interns The Larger Jupyter Team @jupyterlab on GitHub @ProjectJupyter on Twitter
20. 
 JupyterLab: Integrated Experience
21. 
 Building Blocks for Interactive Computing
22. 
 Kernels Output Text Editor Terminal File Browser Notebooks Building Blocks
23. 
 JupyterLab • Work with the building blocks in a flexible and integrated manner • Modern JavaScript development: npm-based packaging, Typescript, phosphor.js • Clean model/view separation • Well separated public/private APIs • Fully extensible by third parties • High performance • Design! Building Blocks
24. 
 January 2018 •https://github.com/jupyterlab •~2.5 years worth of development •~100 contributors, ~60 components •~1,800 releases (npm+python) •Over 11,000 commits, ~classic notebook •Currently Beta JupyterLab Today
25. 
 Roadmap • Beta releases, January 2018 • For all users • For adventurous extension developers • 1.0 this year • For all users, extension developers • Eventually: • Classic notebook will be retired JupyterLab Beta: Use It Today conda install -c conda-forge jupyterlab or pip install jupyterlab
26. A Whirlwind Tour of JupyterLab
27. New implementation of the notebook
28. Collapsible cells and draggable cells
29. Collaboration between tools A log in the console of commands executed Explore data in console without messing up your notebook
30. Editors Many different editors; preview markdown
31. Editor connected to a console Connect to console and Shift-Enter to run code snippet
32. Single document mode Shift-Command-Enter to enter single document mode. Similar to classic notebook.
33. Extensible “In one night and a couple of dozen lines of code we wrote a Fasta viewer.”
34. Becomes a notebook extension With the same code, the Fasta viewer becomes an extension usable in the notebook.
35. Datasets, grids, and scale 1.2M rows 200Mb csv file. Excel can’t open. A few seconds to load and then “smooth as butter” when scrolling. Rumor has it that Chris Colbert has a trillion row by column demo too.
36. Live Demo @WillingCarol (Why? Because it's cool how responsive JupyterLab is.)
37. •Drag-and-drop cells in and between notebooks •Run code blocks interactively from text files (.py, .R, .md, .tex, etc.) •Link a code console to a notebook kernel to explore code interactively without cluttering up the notebook with temporary scratch work •Edit popular file formats with live preview, such as Markdown, JSON, CSV, Vega, VegaLite, and more @twitter handle New Functionality
38. SciPy Tutorial 2018 Talk: JupyterLab - The Next Generation JupyterLab Documentation jupyter.org try.jupyter.org Gallery of Interesting Notebooks @WillingCarol Resources • JupyterLab • Jupyter Widgets • JupyterCon
39. 4. JupyterHub 4.1. The Littlest JupyterHub 4.2. Zero to JupyterHub on Kubernetes 5. BinderHub and mybinder.org 6. Wrap up 6.1. Resources 6.2. Questions @WillingCarol Agenda
40. JupyterHub Computational Thinking for Groups @WillingCarol
41. @WillingCarol zero-to-jupyterhub.readthedocs.io Kubernetes
42. @WillingCarol JupyterHub: Deploy with Kubernetes https://zero-to-jupyterhub.readthedocs.io/en/latest/
43. Solving problems using machine learning Usability Reproducibility Collaboration
44. The Littlest JupyterHub @twitter handle
45. Zero to JupyterHub with Kubernetes @twitter handle
46. 4. JupyterHub 4.1. The Littlest JupyterHub 4.2. Zero to JupyterHub on Kubernetes 5. BinderHub and mybinder.org 6. Wrap up 6.1. Resources 6.2. Questions @WillingCarol Agenda
47. Binder https://blog.jupyter.org/binder-2-0-a-tech-guide-2017-fd40515a3a84 https://elifesciences.org/labs/8653a61d/introducing-binder-2-0-share-your- interactive-research-environment https://www.nature.com/articles/d41586-018-01322-9 mybinder.org
48. Build your own BinderHub https://binderhub.readthedocs.io/en/latest/
49. 4. JupyterHub 4.1. The Littlest JupyterHub 4.2. Zero to JupyterHub on Kubernetes 5. BinderHub and mybinder.org 6. Wrap up 6.1. Resources 6.2. Questions 6.3. Thank you and appreciation @WillingCarol Agenda
50. @twitter_handle
51. Get Involved @twitter handle Gitter Chat gitter.im/jupyterhub/jupyterhub gitter.im/jupyterhub/binder gitter.im/jupyterlab/jupyterlab Mailing list groups.google.com/forum/#!forum/jupyter groups.google.com/forum/#!forum/binderhub Deploy your own JupyterHub z2jh.jupyter.org Deploy your own BinderHub binderhub.readthedocs.io
52. Thank You @twitter_handle
53. • Project Jupyter team and community • JupyterLab team • JupyterHub and Binder teams Attributions and recognition
54. Questions? https://jupyter.org @twitter_handle