Practical Python and Jupyter for Data Science and More

@WillingCarol Practical Python and Jupyter for Data Science and Beyond
Carol Willing

@WillingCarol Hi! I'm Carol. • Python Steering Council • Core
Developer • PSF Fellow • PSF Director (Former) • Frank Willison Award 2019 2

@WillingCarol 3 Core maintainer Papermill, Scrapbook, Bookstore, Commuter Steering Council
Core Developer JupyterHub, BinderHub, mybinder.org I create data science tools.

@WillingCarol 4 Core maintainer Papermill, Scrapbook, Bookstore, Commuter Steering Council
Core Developer JupyterHub, BinderHub, mybinder.org I create productivity data science tools.

@WillingCarol Practical Data Science 5 Using data responsibly to solve
real world issues and improve human lives

@WillingCarol 6 Practical Data Science Python + Jupyter + Knowledge
+ Community

@WillingCarol Practical data science grew up around

@WillingCarol 8

@WillingCarol 9 Python + Jupyter + Knowledge + Community

@WillingCarol Python Growth Governance Python 3.8 Farewell to Python 2
10

@WillingCarol Growth 11 Flexible, empowering language Strength of third-party libraries
Community

@WillingCarol 12 What's behind the growth? Web DevOps Systems Testing
Science Data Science Embedded systems Education Micropython, CircuitPython, Raspberry Pi

@WillingCarol 13 Language Design In reality, programming languages are how
programmers express and communicate ideas — and the audience for those ideas is other programmers, not computers. http://neopythonic.blogspot.com/2016/04/kings-day-speech.html Guido van Rossum

@WillingCarol Governance Post-BDFL 14

@WillingCarol PEP 8016 The Steering Council Model 15

@WillingCarol Steering Council 16 Barry Warsaw Brett Cannon Carol Willing
Guido van Rossum Nick Coghlan

@WillingCarol PEP 13 Python Language Governance 17 ‣ Quality and
Stability ‣ Contributing accessible, inclusive, sustainable ‣ Core team and PSF relationship ‣ Decision making processes for PEPs ‣ Seek consensus

@WillingCarol Core Development 18

@WillingCarol Python 3.8 19 https://www.python.org/downloads/release/python-380b3/ https://www.python.org/dev/peps/pep-0569/ Schedule and Content Try
it 3.8-dev currently uses Python 3.8.0b3+ Test your project on Travis CI

@WillingCarol 20 Positional only parameters Assignment operator (walrus operator) "equals"
speciﬁer added to f-string (debugging) PEP 587: Python Initialization Conﬁguration PEP 574: pickle protocol 5 Python 3.8

@WillingCarol Farewell to Python 2 21

@WillingCarol 22 py3readiness.org !22

@WillingCarol 23 2020-01-01 pythonclock.org python3statement.org 23 !23

@WillingCarol 25 jupyter.org

@WillingCarol 26 2014 Now, 5 years later... !26

  Millions of Notebooks https://github.com/trending/jupyter-notebook Over 5 million on GitHub

@WillingCarol 28 Jupyter Growth ACM Award Industry adoption Creative uses
Open Source Book !28

@WillingCarol 29 https://www.youtube.com/watch?v=qbtDVdEr8SY

@WillingCarol ecosystem 30

@WillingCarol 32

@WillingCarol 33 Prepare Explore Prototype Production

@WillingCarol Prepare Getting Started and Leveling up 34 Step 1

@WillingCarol Getting Started and Leveling Up 35 Try it in
the browser Install Python Install Libraries Choose your tools

@WillingCarol 36 Binder 2.0 blog post elifesciences: Share your interactive
research environment Nature article about Binder !36 mybinder.org Try it in the browser

@WillingCarol 37

jupyter.org

@WillingCarol pyodide 39 Try it in the Browser

@WillingCarol Install Python 40 Use the OS Package Manager Use
a Distribution - Anaconda, miniconda Download from Python.org

@WillingCarol Install Libraries 41 Use a Distribution such as Anaconda
Use pip Use miniconda, conda, and conda-forge

@WillingCarol 42 python3 -m venv myenv source myenv/bin/activate pip install
jupyter jupyter notebook

@WillingCarol 43 conda create -n myenv python=3.7 conda activate myenv
conda install jupyter jupyter notebook

@WillingCarol Choose your Tools 44

@WillingCarol JupyterLab 45 Congrats! JupyterLab team releases 1.0 version.

@WillingCarol 46 nteract ReactJS front end

@WillingCarol nteract 47 Jupyter's open notebook format, protocol, and language
kernel standards enable different user interfaces.

@WillingCarol VS Code 48 PyCharm

@WillingCarol Exploration 49 Step 2

@WillingCarol Exploring data and libraries 50 Start with your interests
Try a tutorial Learning resources Community What's new

@WillingCarol Start with your interests I usually create music projects
when exploring new languages. 51 https://web.mit.edu/music21/

@WillingCarol Try a library's tutorial Pandas Matplotlib 52

@WillingCarol 53

@WillingCarol Learning resources 54 Online Books with Jupyter Notebooks Conferences,
pyvideo.org and YouTube https://jakevdp.github.io/PythonDataScienceHandbook/

@WillingCarol Learn AI online 55

@WillingCarol Community 56 User groups Meetups PyLadies Carpentries

@WillingCarol What's new 57 Talk Python to Me Tracking Jupyter
Newsletter https://tinyletter.com/TrackingJupyter/archive Open Source Directions webinar GitHub Trending Follow projects on Social Media

@WillingCarol Prototyping 58 Step 3

@WillingCarol 59 Ten Simple Rules for Reproducible Research in Jupyter
Notebooks Adam Rule et al. https://github.com/jupyter-guide/ ten-rules-jupyter https://github.com/jupyter-guide/ jupyter-guide

@WillingCarol 60 https://github.com/data-exp-lab/rust-yt-tools/ npm package @data-exp-lab/yt-tools Irber Junior LC. Oxidizing
Python: writing extensions in Rust [version 1; not peer reviewed]. F1000Research 2018, 7(ISCB Comm J):955 (poster) (https://doi.org/10.7490/f1000research. 1115726.1) https://github.com/munkm/widgyts yt and jupyter widgets !60

@WillingCarol 61 ipyvolume https://towardsdatascience.com/multivolume- rendering-in-jupyter-with-ipyvolume-cross- language-3d-visualization-64389047634a

@WillingCarol 62

@WillingCarol 63 https://github.com/pydy/pydy-tutorial-human-standing https://mybinder.org/v2/gh/willingc/pydy-tutorial-human-standing/master

@WillingCarol 64 Animation !64 jupyter.org

@WillingCarol Production 65 Step 4

@WillingCarol 66 Focus on your impact

@WillingCarol 67 Papermill Scrapbook Bookstore Commuter Production data at scale
!67 https://medium.com/netﬂix-techblog/notebook-innovation-591ee3221233

@WillingCarol 68 Papermill - parameterize / run Scrapbook - recording
/ reading Bookstore - store notebooks Commuter - share notebooks Production data at scale !68

@WillingCarol 69 Enterprise data workﬂows !69

zero-to-jupyterhub.readthedocs.io

@WillingCarol 71 !71 Deploy binders

!72 Juliette Taka

@WillingCarol 73 From a phone in the park! !73

@WillingCarol 74 Getting started & leveling up Exploration Prototyping Production

@WillingCarol 76 – Guido van Rossum ...a programming language created
by a community fosters happiness in its users around the world. http://neopythonic.blogspot.com/2016/04/kings-day-speech.html

@WillingCarol 77 –Tim O'Reilly Contributions can encompass so much more
than code. A successful software community requires time, dedication, communication, and education as well as elegant code.

@WillingCarol 78 Be Practical and Productive

@WillingCarol 80 Designed for success Try it today

@WillingCarol 81 Create your dreams

@WillingCarol 82 the future of Python depends on

@WillingCarol 83 YOU

@WillingCarol 84 Thank you @WillingCarol willingc on GitHub

@WillingCarol 85 Join the

@WillingCarol 86 Questions

@WillingCarol 87 Thank you Project Jupyter Team Core Python Team
PSF

@WillingCarol Attributions 88 Attributions on slides. Photos [2, 3, 4,
5, 6, 7, 45, 55, 56, 62, 67, 68, 70] Carol Willing and Linnea Willing [38] The Carpentries, Tracy Teal, Bérénice Batut

Practical Python and Jupyter for Data Science a...

Practical Python and Jupyter for Data Science and More

More Decks by Carol Willing

Other Decks in Technology

Featured

Transcript