Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Jupyter: Always Open for Learning and Discovery

Jupyter: Always Open for Learning and Discovery

SciPy 2019 keynote. The keynote explores how open information improves learning and discovery. The impact of open information on society is covered along with actions that businesses, educators, and researchers can take to support the open source scientific projects.

Carol Willing
PRO

July 12, 2019
Tweet

More Decks by Carol Willing

Other Decks in Science

Transcript

  1. @WillingCarol
    Always Open
    for Learning and
    Discovery
    Carol Willing

    View Slide

  2. @WillingCarol 2
    """SciPy_Gratitude.py"""
    import all_the_projects
    def say_thanks(name):
    while True:
    print(f'Thank you {name}!')
    make_investment(amount, name)
    # TODO Refactor to maintainer module
    def cite_project(name):
    publish_to_JOSS(name)
    create_binder_link(name)
    Keynote
    1.0 beta
    Contributions
    and PRs are
    welcome.
    See you at the
    sprints. We
    welcome you
    and will help you
    get started.

    View Slide

  3. @WillingCarol
    Uncertainty
    3

    View Slide

  4. @WillingCarol
    imperfect or unknown
    information
    4

    View Slide

  5. @WillingCarol 5

    View Slide

  6. @WillingCarol 6

    View Slide

  7. @WillingCarol 7

    View Slide

  8. @WillingCarol 8
    It is advisable to look from the
    tide pools to the stars and then
    back to the tide pool again.
    John Steinbeck

    View Slide

  9. @WillingCarol 9

    View Slide

  10. @WillingCarol 10
    uncertainty
    information
    ecosystem
    learning
    discovery
    motivations
    economics

    View Slide

  11. @WillingCarol 11
    Information is the resolution of
    uncertainty.
    Claude Shannon

    View Slide

  12. @WillingCarol
    Always Open
    Journey
    Stage I: Learning
    Stage II: Discovery
    Stage III: Impact
    12

    View Slide

  13. @WillingCarol
    Our journey begins
    13

    View Slide

  14. @WillingCarol
    Small group
    14

    View Slide

  15. @WillingCarol
    Large Corporations
    15
    Google
    Microsoft
    Amazon
    Apple Facebook
    https://mitsmr.com/2H6P9jk

    View Slide

  16. @WillingCarol
    New
    Technologies
    16
    GPUs
    JavaScript
    Deep learning libraries
    Kubernetes and cloud services
    WebAssembly

    View Slide

  17. @WillingCarol
    PLOT TWIST
    17

    View Slide

  18. @WillingCarol 18
    1989

    View Slide

  19. @WillingCarol 19
    World events

    View Slide

  20. @WillingCarol 20
    Mobile: Introduced a cell
    phone weighing less than
    3.2 kg
    Internet: Infancy at CERN
    World Wide Web: Draft
    https://infinitehistory.mit.edu/video/timothy-j-berners-lee
    Dial-up: Available in
    North America
    1989

    View Slide

  21. @WillingCarol
    Large Corporations
    21
    Microsoft
    Apple

    View Slide

  22. @WillingCarol
    Large Corporations
    22
    IBM
    Microsoft
    HP
    Apple AT&T

    View Slide

  23. @WillingCarol
    Octel Communications Corporation
    Small group
    23

    View Slide

  24. @WillingCarol 24

    View Slide

  25. @WillingCarol 25

    View Slide

  26. @WillingCarol 26
    Octel's
    Mission

    View Slide

  27. @WillingCarol 27
    Transparent Mission
    Ethics
    ...meet customers' needs in everything we do.
    Each employee has a customer.
    Making mistakes can help people grow.
    We succeed together.
    We respect our ethical obligations.
    Winning is only acceptable if we win
    fairly and honestly.
    People
    Value

    View Slide

  28. @WillingCarol 28
    People before things

    View Slide

  29. @WillingCarol 29

    View Slide

  30. @WillingCarol
    1997
    30
    Transparent
    information
    built trust.
    Together, we
    succeeded.

    View Slide

  31. @WillingCarol 31

    View Slide

  32. @WillingCarol 32
    2014

    View Slide

  33. @WillingCarol 33
    New faces at SciPy 2014

    View Slide

  34. @WillingCarol 34

    View Slide

  35. @WillingCarol 35
    2019

    View Slide

  36. @WillingCarol 36

    View Slide

  37. @WillingCarol
    ecosystem
    37

    View Slide

  38. @WillingCarol
    Always Open for
    Learning
    38
    Stage I

    View Slide

  39. @WillingCarol
    Open standard
    39
    Congrats!
    JupyterLab
    team
    releases 1.0
    version.

    View Slide

  40. @WillingCarol
    Innovation and learning
    40
    nteract
    Jupyter's open notebook format, protocol, and language kernel
    standards enable different user interfaces.
    pyodide

    View Slide

  41. @WillingCarol 41
    Knowledge sharing
    https://jupyter4edu.github.io/jupyter-edu-book/ https://jose.theoj.org/

    View Slide

  42. @WillingCarol
    Adoption
    42

    View Slide

  43. @WillingCarol
    Access
    43
    Code+Chords
    https://youtu.be/Y1x6bk8nvog
    Through empathetical
    design, we are able to bypass
    the machine-like nature of
    programming and open up
    new possibilities for creative
    programing.
    Cullen Kittams
    Code + Chords
    https://github.com/PlayfulLearningLab/CodeAndChords
    https://www.annmarie-thomas.com/
    https://www.playfullearninglab.org
    Dr. AnnMarie Thomas

    View Slide

  44. @WillingCarol
    Scaling Access
    44

    View Slide

  45. @WillingCarol
    Global Connection
    45

    View Slide

  46. @WillingCarol
    Innovation
    Knowledge sharing
    Adoption and access
    Scaling access
    Global connection
    46
    Always open for learning

    View Slide

  47. @WillingCarol
    Always Open for
    Discovery
    47
    Stage II

    View Slide

  48. @WillingCarol
    Binder
    48
    Always Open for Discovery

    View Slide

  49. @WillingCarol 49
    Ten Simple Rules
    for Reproducible
    Research in
    Jupyter Notebooks
    Adam Rule et al.
    https://github.com/jupyter-guide/
    ten-rules-jupyter
    https://github.com/jupyter-guide/
    jupyter-guide
    Always Open for Discovery

    View Slide

  50. @WillingCarol
    Citations
    50
    Always Open for Discovery
    Jupyter Citations
    Number
    0
    1000
    2000
    3000
    4000
    2015 2016 2017 2018 2019 Projected

    View Slide

  51. @WillingCarol 51
    Always Open for Discovery
    Publishing

    View Slide

  52. @WillingCarol 52
    https://joss.theoj.org/about#costs
    Publishing
    Always Open for Discovery

    View Slide

  53. @WillingCarol 53
    Open Research
    Collaboration
    https://nasa.github.io/openmct/
    https://arc.aiaa.org/doi/pdf/10.2514/6.2018-2508

    View Slide

  54. @WillingCarol
    Funding Essential
    Software
    54
    Chan Zuckerberg Science Initiative
    Supporting the Computational
    Foundations of Biology
    Watch Jeremy Freeman's SciPy 2019
    Talk for more information.
    Always Open for Discovery
    https://medium.com/@cziscience/essential-open-source-software-for-science-72faec2c38c1

    View Slide

  55. @WillingCarol
    The Impact of
    Open Information
    55
    Stage III

    View Slide

  56. @WillingCarol 56
    User
    innovators
    The Impact of Open Information
    The Age of the Consumer Innovator.
    von Hippel, Ogawa, de Jong
    Sloan Management Review. Fall 2011
    Robot Build illustration by Amy Davis Roth. Used with permission.

    View Slide

  57. @WillingCarol 57
    https://frankieflood.blogspot.com/search/label/viola%20bow%20holder https://3dprint.nih.gov

    View Slide

  58. @WillingCarol 58
    Value
    creation
    The Impact of Open Information

    View Slide

  59. @WillingCarol
    win - win - $$$
    59
    The Impact of Open Information
    https://boldandopen.com

    View Slide

  60. @WillingCarol 60
    Collaborating for a cure
    The Impact of Open Information

    View Slide

  61. @WillingCarol 61
    2005

    View Slide

  62. @WillingCarol 62
    2013

    View Slide

  63. @WillingCarol 63
    https://simexp.github.io/vcog_hps_ad_book/intro.html
    Jupyter Book
    Binder
    Jupyter
    pandas
    scipy
    scikit learn
    matplotlib
    numpy
    seaborn
    The Impact of Open Information
    Canadian Open Neuroscience Platform

    View Slide

  64. @WillingCarol
    Act intentionally
    64

    View Slide

  65. @WillingCarol
    Choose always open
    information by default
    65

    View Slide

  66. @WillingCarol 66
    Avoid opaque
    information

    View Slide

  67. @WillingCarol
    Proceed cautiously
    with pseudo-open
    projects
    67

    View Slide

  68. @WillingCarol
    Plan
    Execute
    Change
    68
    https://jupyterhub-team-compass.readthedocs.io
    https://github.com/jupyterhub/team-compass

    View Slide

  69. @WillingCarol
    Money, Money, Money
    69

    View Slide

  70. @WillingCarol
    Read
    70

    View Slide

  71. @WillingCarol
    Good: Use open source without investment
    Better: Make a "public relations"-driven
    minimal viable investment
    Best: Contribute an ethical amount of your
    gained value back ($, resources, personnel)
    71
    Business and industry
    Choose your own open source adventure

    View Slide

  72. @WillingCarol
    1. Make your project citable (JOSS, JOSE)
    2. Measure your project's impact on discovery
    3. Develop best practices on soliciting funding
    from philanthropies, grants, and industry
    4. Practice self care to avoid burnout alligators
    72
    Project maintainers
    Choose your own adventure

    View Slide

  73. @WillingCarol
    Extract the hidden value in
    obvious insights
    73
    I would never have predicted that meeting a single
    person who benefitted from your work could be
    enough to double your effort and triple your
    productivity.
    Adam Grant - Sloan SMR Spring 2019
    Adam Grant

    View Slide

  74. @WillingCarol 74
    Focus on your impact

    View Slide

  75. @WillingCarol
    2024
    75

    View Slide

  76. @WillingCarol 76
    Uncertainty

    View Slide

  77. @WillingCarol 77
    Information
    Always Open
    Learning and Discovery

    View Slide

  78. @WillingCarol 78

    View Slide

  79. @WillingCarol 79
    Thank you

    View Slide

  80. @WillingCarol 80
    Thank you
    SciPy 2019 Organizers
    Project Jupyter Team
    Min Ragan-Kelly

    View Slide

  81. @WillingCarol
    Attributions
    81
    TODO: Add slide by slide references to published research, projects, and
    drawings
    [21] Media links
    [25] Drawing by Karen Rustad
    [59] Art by Amy Davis Roth, used with permission
    Photos
    [2, 3, 4, 5, 6, 7, 45, 55, 56, 62, 67, 68, 70] Carol Willing and Linnea Willing
    [22] Octel Communications Corporation
    [38] The Carpentries, Tracy Teal, Bérénice Batut
    [53] NIH

    View Slide

  82. @WillingCarol
    Additional content on
    learning
    82

    View Slide

  83. Engineering Possibilities in College

    View Slide

  84. View Slide

  85. Solution
    https://github.com/willingc/epic-interactive
    https://speakerdeck.com/willingc/interactivity-in-computer-science

    View Slide

  86. https://willingc.github.io/epic-site/

    View Slide

  87. View Slide

  88. View Slide