Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Practical Data Science with Python and Jupyter

Practical Data Science with Python and Jupyter

Python Brasil 2019 keynote in Ribeirao Preto. Python and Jupyter provide the tools and libraries for Practical Data Science.

What is Practical Data Science? Practical Data Science uses data responsibly to solve real world issues, such as climate change and disease, and improve human lives.

The keynote gives a state of Python and Jupyter in 2019. It outlines three major steps for Practical Data Science: Start, Explore, Deploy. Weather and climate are used as evidence of the impact and importance of data science predictions.

Carol Willing

October 25, 2019

More Decks by Carol Willing

Other Decks in Technology


  1. @WillingCarol Hi! I'm Carol. • Python Steering Council • Core

    Developer • PSF Fellow • PSF Director (Former) • Frank Willison Award 2019 2
  2. @WillingCarol 3 Core maintainer Papermill, Scrapbook, Bookstore, Commuter Steering Council,

    Core Developer JupyterHub, BinderHub, mybinder.org I love creating tools which educate and empower people.
  3. Copyright: 2019 European Union, contains modified Copernicus Sentinel data 2019,

    processed by EUMETSAT Super Typhoon Hagibis View of Super Typhoon Hagibis south-west of Japan, as captured by the Copernicus Sentinel-3 satellite on 08 October at 00:16 UTC.
  4. Title Typhoon Hagibis Released 10/10/2019 4:45 pm Copyright contains modified

    Copernicus Sentinel data (2019), processed by ESA, CC BY-SA 3.0 IGO
  5. A sign is partially submerged as the Tama River floods

    during Typhoon Hagibis. Source:Getty Images Source:Japan Times
  6. @WillingCarol 23 Python's Growth in 2019 Web DevOps Systems Testing

    Science Data Science Embedded systems Education Micropython, CircuitPython, Raspberry Pi
  7. @WillingCarol PEP 13 Python Language Governance 27 ‣ Quality and

    Stability ‣ Contributing accessible, inclusive, sustainable ‣ Core team and PSF relationship ‣ Decision making processes for PEPs ‣ Seek consensus
  8. @WillingCarol 30 Positional only parameters Assignment operator (walrus operator) "equals"

    specifier added to f-string (debugging) PEP 587: Python Initialization Configuration PEP 574: pickle protocol 5 Python 3.8
  9. @WillingCarol 39 ‣ Growth ‣ ACM Award ‣ Industry adoption

    ‣ Creative uses ‣ Open Source Book https://www.youtube.com/watch?v=qbtDVdEr8SY
  10. @WillingCarol 45 Binder 2.0 blog post elifesciences: Share your interactive

    research environment Nature article about Binder 45 mybinder.org Try it in the browser
  11. @WillingCarol Install Python 48 Use the OS Package Manager Use

    a Distribution - Anaconda, miniconda Download from Python.org
  12. @WillingCarol Install Libraries 49 Use a Distribution such as Anaconda

    Use pip Use miniconda, conda, and conda-forge
  13. @WillingCarol 51 conda create -n myenv python=3.7 conda activate myenv

    conda install jupyter -c conda-forge jupyter notebook
  14. @WillingCarol Start 56 Try it in the browser Install Python

    Install Libraries Choose your tools Step 1
  15. @WillingCarol Start with your interests I usually create music projects

    when exploring new languages. 58 https://web.mit.edu/music21/
  16. @WillingCarol Learning resources 64 Online Books with Jupyter Notebooks Conferences,

    pyvideo.org and YouTube Research papers, blogs Source: O'Reilly
  17. @WillingCarol 65 Ten Simple Rules for Reproducible Research in Jupyter

    Notebooks Adam Rule et al. https://github.com/jupyter-guide/ ten-rules-jupyter https://github.com/jupyter-guide/ jupyter-guide
  18. @WillingCarol What's new 68 Talk Python to Me Tracking Jupyter

    Newsletter https://tinyletter.com/TrackingJupyter/archive Open Source Directions GitHub Trending Follow projects on Social Media
  19. @WillingCarol Explore 69 Start with your interests Try a tutorial

    Learning resources Community What's new Step 2
  20. @WillingCarol 72 nteract Papermill Scrapbook Bookstore Commuter Production data at

    scale 72 https://medium.com/netflix-techblog/notebook-innovation-591ee3221233 Bookstore
  21. @WillingCarol 73 Papermill - parameterize / run Scrapbook - recording

    / reading Bookstore - store notebooks Commuter - share notebooks Production data at scale 73
  22. @WillingCarol Build Community 89 Python Brasil official photo. The sign

    represents Python in BSL (Brazilian Sign Language), made by Amanda and Sávio at Python Sul 2018 https://pyfound.blogspot.com/2019/02/python-brasil-people-technology.html PyLadiesBRConf official photo PyLadiesBRConf official photo
  23. @WillingCarol Attributions 97 Attributions on slides. Photos [7-10] Carol Willing

    and Linnea Willing [38] The Carpentries, Tracy Teal, Bérénice Batut [17] Godzilla By Toho Company Ltd. (東宝株式会社, Tōhō Kabushiki-kaisha) © 1954 - movie poster made by Toho Company Ltd. (東宝株式会社, Tōhō Kabushiki-kaisha), Public Domain, https://commons.wikimedia.org/w/index.php?curid=3648684