Practical Data Science with Python and Jupyter

@WillingCarol Practical Data Science with Python and Jupyter Carol Willing
Python Brasil October 25, 2019

@WillingCarol Hi! I'm Carol. • Python Steering Council • Core
Developer • PSF Fellow • PSF Director (Former) • Frank Willison Award 2019 2

@WillingCarol 3 Core maintainer Papermill, Scrapbook, Bookstore, Commuter Steering Council,
Core Developer JupyterHub, BinderHub, mybinder.org I love creating tools which educate and empower people.

@WillingCarol Practical Data Science 4

@WillingCarol 5 Using data responsibly to solve real world issues
and improve human lives

@WillingCarol 6 A Story Python Jupyter Practical Data Science

@WillingCarol 7 San Diego, CA

@WillingCarol 8

@WillingCarol 9

@WillingCarol 10 Tokyo

@WillingCarol 11

Copyright: 2019 European Union, contains modiﬁed Copernicus Sentinel data 2019,
processed by EUMETSAT Super Typhoon Hagibis View of Super Typhoon Hagibis south-west of Japan, as captured by the Copernicus Sentinel-3 satellite on 08 October at 00:16 UTC.

Title Typhoon Hagibis Released 10/10/2019 4:45 pm Copyright contains modiﬁed
Copernicus Sentinel data (2019), processed by ESA, CC BY-SA 3.0 IGO

Source:Twitter

A sign is partially submerged as the Tama River ﬂoods
during Typhoon Hagibis. Source:Getty Images Source:Japan Times

@WillingCarol 16

@WillingCarol 17

@WillingCarol Preparation Evacuation Safety 18

Title: Typhoon Bualoi 10/24/2019 Source: JTWC/SATOPS

@WillingCarol 20 Python

@WillingCarol Practical data science grew up around

@WillingCarol Python - 2019 Governance Python 3.8 Farewell to Python
2 22

@WillingCarol 23 Python's Growth in 2019 Web DevOps Systems Testing
Science Data Science Embedded systems Education Micropython, CircuitPython, Raspberry Pi

@WillingCarol Governance Post-BDFL 24

@WillingCarol PEP 8016 The Steering Council Model 25

@WillingCarol Steering Council 26 Barry Warsaw Brett Cannon Carol Willing
Guido van Rossum Nick Coghlan

@WillingCarol PEP 13 Python Language Governance 27 ‣ Quality and
Stability ‣ Contributing accessible, inclusive, sustainable ‣ Core team and PSF relationship ‣ Decision making processes for PEPs ‣ Seek consensus

@WillingCarol Core Development 28

@WillingCarol Python 3.8 29 https://www.python.org/downloads/ https://www.python.org/dev/peps/pep-0569/ Schedule and Content Try
it

@WillingCarol 30 Positional only parameters Assignment operator (walrus operator) "equals"
speciﬁer added to f-string (debugging) PEP 587: Python Initialization Conﬁguration PEP 574: pickle protocol 5 Python 3.8

@WillingCarol 31

@WillingCarol 32

@WillingCarol Farewell to Python 2 33

@WillingCarol 34 Jupyter

@WillingCarol 35 jupyter.org

@WillingCarol 36 2014 Now, 5 years later... 36

  Millions of Notebooks https://github.com/trending/jupyter-notebook Over 5 million on GitHub

jupyter.org

@WillingCarol 39 ‣ Growth ‣ ACM Award ‣ Industry adoption
‣ Creative uses ‣ Open Source Book https://www.youtube.com/watch?v=qbtDVdEr8SY

@WillingCarol JupyterLab 40

@WillingCarol ecosystem 41

@WillingCarol 42 Practical Data Science Source: xkcd

@WillingCarol 43 Start Deploy Explore Practical Data Science

@WillingCarol Start 44 Step 1

@WillingCarol 45 Binder 2.0 blog post elifesciences: Share your interactive
research environment Nature article about Binder 45 mybinder.org Try it in the browser

46 jupyter.org demo

47 jupyter.org demo

@WillingCarol Install Python 48 Use the OS Package Manager Use
a Distribution - Anaconda, miniconda Download from Python.org

@WillingCarol Install Libraries 49 Use a Distribution such as Anaconda
Use pip Use miniconda, conda, and conda-forge

@WillingCarol 50 python3 -m venv myenv source myenv/bin/activate pip install
jupyter jupyter notebook

@WillingCarol 51 conda create -n myenv python=3.7 conda activate myenv
conda install jupyter -c conda-forge jupyter notebook

@WillingCarol Choose your Tools 52

@WillingCarol JupyterLab 53

@WillingCarol 54 ReactJS front end nteract nteract.io

@WillingCarol VS Code 55 PyCharm

@WillingCarol Start 56 Try it in the browser Install Python
Install Libraries Choose your tools Step 1

@WillingCarol Explore 57 Step 2

@WillingCarol Start with your interests I usually create music projects
when exploring new languages. 58 https://web.mit.edu/music21/

@WillingCarol 59 Try a library's tutorial

@WillingCarol 60

@WillingCarol 61 ipyvolume https://towardsdatascience.com/multivolume- rendering-in-jupyter-with-ipyvolume-cross- language-3d-visualization-64389047634a

@WillingCarol 62

@WillingCarol 63 github.com/napari/napari napari https://ilovesymposia.com/2019/10/24/introducing-napari- a-fast-n-dimensional-image-viewer-in-python/

@WillingCarol Learning resources 64 Online Books with Jupyter Notebooks Conferences,
pyvideo.org and YouTube Research papers, blogs Source: O'Reilly

@WillingCarol 65 Ten Simple Rules for Reproducible Research in Jupyter
Notebooks Adam Rule et al. https://github.com/jupyter-guide/ ten-rules-jupyter https://github.com/jupyter-guide/ jupyter-guide

@WillingCarol Learn AI online 66

@WillingCarol Community 67 User groups Meetups PyLadies Carpentries Photo: Python
Sul

@WillingCarol What's new 68 Talk Python to Me Tracking Jupyter
Newsletter https://tinyletter.com/TrackingJupyter/archive Open Source Directions GitHub Trending Follow projects on Social Media

@WillingCarol Explore 69 Start with your interests Try a tutorial
Learning resources Community What's new Step 2

@WillingCarol Deploy 70 Step 3

@WillingCarol Notebooks to web 71 https://blog.jupyter.org/and- voil%C3%A0-f6a2c08a4a93

@WillingCarol 72 nteract Papermill Scrapbook Bookstore Commuter Production data at
scale 72 https://medium.com/netﬂix-techblog/notebook-innovation-591ee3221233 Bookstore

@WillingCarol 73 Papermill - parameterize / run Scrapbook - recording
/ reading Bookstore - store notebooks Commuter - share notebooks Production data at scale 73

@WillingCarol 74 Enterprise data workﬂows 74

@WillingCarol 75 https://medium.com/dagster-io/dagster-0-6-0-impossible-princess-898b459375e0 Pipelines

zero-to-jupyterhub.readthedocs.io

https://blog.jupyter.org/simpler-authentication-for-small- scale-jupyterhubs-with-nativeauthenticator-999534c77a09 Native Authenticator Thank you Leticia

@WillingCarol 78 78 Deploy binders

79 Juliette Taka

@WillingCarol 80 From a phone in the park! 80

@WillingCarol Pangeo 81 https://pangeo.io

@WillingCarol 82

@WillingCarol 83 https://simexp.github.io/vcog_hps_ad_book/intro.html Jupyter Book Binder Jupyter pandas scipy scikit
learn matplotlib numpy seaborn Canadian Open Neuroscience Platform

@WillingCarol 84 Practical Data Science How?

@WillingCarol Start 85

@WillingCarol Ask why 86

@WillingCarol Plan Execute Change 87 https://jupyterhub-team-compass.readthedocs.io https://github.com/jupyterhub/team-compass

@WillingCarol Share binders. Foster research. 88

@WillingCarol Build Community 89 Python Brasil official photo. The sign
represents Python in BSL (Brazilian Sign Language), made by Amanda and Sávio at Python Sul 2018 https://pyfound.blogspot.com/2019/02/python-brasil-people-technology.html PyLadiesBRConf official photo PyLadiesBRConf official photo

@WillingCarol 90 Python Brasil Practical Data Science

@WillingCarol 91 Python Brasil Changing the world together

@WillingCarol 92 Thank you https://speakerdeck.com/willingc @WillingCarol

@WillingCarol 93 Join the

@WillingCarol 94 Questions https://speakerdeck.com/willingc

@WillingCarol 95 Karaoke Time Lorena, This is for you. https://www.youtube.com/watch?v=m41cVv3tChE

@WillingCarol 96 Thank you Python Brasil Project Jupyter Team Core
Python Team PSF

@WillingCarol Attributions 97 Attributions on slides. Photos [7-10] Carol Willing
and Linnea Willing [38] The Carpentries, Tracy Teal, Bérénice Batut [17] Godzilla By Toho Company Ltd. (東宝株式会社, Tōhō Kabushiki-kaisha) © 1954 - movie poster made by Toho Company Ltd. (東宝株式会社, Tōhō Kabushiki-kaisha), Public Domain, https://commons.wikimedia.org/w/index.php?curid=3648684

Practical Data Science with Python and Jupyter

Practical Data Science with Python and Jupyter

More Decks by Carol Willing

Other Decks in Technology

Featured

Transcript