Jupyter: Always Open for Learning and Discovery

SciPy 2019 keynote. The keynote explores how open information improves learning and discovery. The impact of open information on society is covered along with actions that businesses, educators, and researchers can take to support the open source scientific projects.

Transcript

1. @WillingCarol
   Always Open
   for Learning and
   Discovery
   Carol Willing
   

   View Slide

2. @WillingCarol 2
   """SciPy_Gratitude.py"""
   import all_the_projects
   def say_thanks(name):
   while True:
   print(f'Thank you {name}!')
   make_investment(amount, name)
   # TODO Refactor to maintainer module
   def cite_project(name):
   publish_to_JOSS(name)
   create_binder_link(name)
   Keynote
   1.0 beta
   Contributions
   and PRs are
   welcome.
   See you at the
   sprints. We
   welcome you
   and will help you
   get started.
   

   View Slide

3. @WillingCarol
   Uncertainty
   3
   

   View Slide

4. @WillingCarol
   imperfect or unknown
   information
   4
   

   View Slide

5. @WillingCarol 5
   

   View Slide

6. @WillingCarol 6
   

   View Slide

7. @WillingCarol 7
   

   View Slide

8. @WillingCarol 8
   It is advisable to look from the
   tide pools to the stars and then
   back to the tide pool again.
   John Steinbeck
   

   View Slide

9. @WillingCarol 9
   

   View Slide

10. @WillingCarol 10
    uncertainty
    information
    ecosystem
    learning
    discovery
    motivations
    economics
    

    View Slide

11. @WillingCarol 11
    Information is the resolution of
    uncertainty.
    Claude Shannon
    

    View Slide

12. @WillingCarol
    Always Open
    Journey
    Stage I: Learning
    Stage II: Discovery
    Stage III: Impact
    12
    

    View Slide

13. @WillingCarol
    Our journey begins
    13
    

    View Slide

14. @WillingCarol
    Small group
    14
    

    View Slide

15. @WillingCarol
    Large Corporations
    15
    Google
    Microsoft
    Amazon
    Apple Facebook
    https://mitsmr.com/2H6P9jk
    

    View Slide

16. @WillingCarol
    New
    Technologies
    16
    GPUs
    JavaScript
    Deep learning libraries
    Kubernetes and cloud services
    WebAssembly
    

    View Slide

17. @WillingCarol
    PLOT TWIST
    17
    

    View Slide

18. @WillingCarol 18
    1989
    

    View Slide

19. @WillingCarol 19
    World events
    

    View Slide

20. @WillingCarol 20
    Mobile: Introduced a cell
    phone weighing less than
    3.2 kg
    Internet: Infancy at CERN
    World Wide Web: Draft
    https://infinitehistory.mit.edu/video/timothy-j-berners-lee
    Dial-up: Available in
    North America
    1989
    

    View Slide

21. @WillingCarol
    Large Corporations
    21
    Microsoft
    Apple
    

    View Slide

22. @WillingCarol
    Large Corporations
    22
    IBM
    Microsoft
    HP
    Apple AT&T
    

    View Slide

23. @WillingCarol
    Octel Communications Corporation
    Small group
    23
    

    View Slide

24. @WillingCarol 24
    

    View Slide

25. @WillingCarol 25
    

    View Slide

26. @WillingCarol 26
    Octel's
    Mission
    

    View Slide

27. @WillingCarol 27
    Transparent Mission
    Ethics
    ...meet customers' needs in everything we do.
    Each employee has a customer.
    Making mistakes can help people grow.
    We succeed together.
    We respect our ethical obligations.
    Winning is only acceptable if we win
    fairly and honestly.
    People
    Value
    

    View Slide

28. @WillingCarol 28
    People before things
    

    View Slide

29. @WillingCarol 29
    

    View Slide

30. @WillingCarol
    1997
    30
    Transparent
    information
    built trust.
    Together, we
    succeeded.
    

    View Slide

31. @WillingCarol 31
    

    View Slide

32. @WillingCarol 32
    2014
    

    View Slide

33. @WillingCarol 33
    New faces at SciPy 2014
    

    View Slide

34. @WillingCarol 34
    

    View Slide

35. @WillingCarol 35
    2019
    

    View Slide

36. @WillingCarol 36
    

    View Slide

37. @WillingCarol
    ecosystem
    37
    

    View Slide

38. @WillingCarol
    Always Open for
    Learning
    38
    Stage I
    

    View Slide

39. @WillingCarol
    Open standard
    39
    Congrats!
    JupyterLab
    team
    releases 1.0
    version.
    

    View Slide

40. @WillingCarol
    Innovation and learning
    40
    nteract
    Jupyter's open notebook format, protocol, and language kernel
    standards enable different user interfaces.
    pyodide
    

    View Slide

41. @WillingCarol 41
    Knowledge sharing
    https://jupyter4edu.github.io/jupyter-edu-book/ https://jose.theoj.org/
    

    View Slide

42. @WillingCarol
    Adoption
    42
    

    View Slide

43. @WillingCarol
    Access
    43
    Code+Chords
    https://youtu.be/Y1x6bk8nvog
    Through empathetical
    design, we are able to bypass
    the machine-like nature of
    programming and open up
    new possibilities for creative
    programing.
    Cullen Kittams
    Code + Chords
    https://github.com/PlayfulLearningLab/CodeAndChords
    https://www.annmarie-thomas.com/
    https://www.playfullearninglab.org
    Dr. AnnMarie Thomas
    

    View Slide

44. @WillingCarol
    Scaling Access
    44
    

    View Slide

45. @WillingCarol
    Global Connection
    45
    

    View Slide

46. @WillingCarol
    Innovation
    Knowledge sharing
    Adoption and access
    Scaling access
    Global connection
    46
    Always open for learning
    

    View Slide

47. @WillingCarol
    Always Open for
    Discovery
    47
    Stage II
    

    View Slide

48. @WillingCarol
    Binder
    48
    Always Open for Discovery
    

    View Slide

49. @WillingCarol 49
    Ten Simple Rules
    for Reproducible
    Research in
    Jupyter Notebooks
    Adam Rule et al.
    https://github.com/jupyter-guide/
    ten-rules-jupyter
    https://github.com/jupyter-guide/
    jupyter-guide
    Always Open for Discovery
    

    View Slide

50. @WillingCarol
    Citations
    50
    Always Open for Discovery
    Jupyter Citations
    Number
    0
    1000
    2000
    3000
    4000
    2015 2016 2017 2018 2019 Projected
    

    View Slide

51. @WillingCarol 51
    Always Open for Discovery
    Publishing
    

    View Slide

52. @WillingCarol 52
    https://joss.theoj.org/about#costs
    Publishing
    Always Open for Discovery
    

    View Slide

53. @WillingCarol 53
    Open Research
    Collaboration
    https://nasa.github.io/openmct/
    https://arc.aiaa.org/doi/pdf/10.2514/6.2018-2508
    

    View Slide

54. @WillingCarol
    Funding Essential
    Software
    54
    Chan Zuckerberg Science Initiative
    Supporting the Computational
    Foundations of Biology
    Watch Jeremy Freeman's SciPy 2019
    Talk for more information.
    Always Open for Discovery
    https://medium.com/@cziscience/essential-open-source-software-for-science-72faec2c38c1
    

    View Slide

55. @WillingCarol
    The Impact of
    Open Information
    55
    Stage III
    

    View Slide

56. @WillingCarol 56
    User
    innovators
    The Impact of Open Information
    The Age of the Consumer Innovator.
    von Hippel, Ogawa, de Jong
    Sloan Management Review. Fall 2011
    Robot Build illustration by Amy Davis Roth. Used with permission.
    

    View Slide

57. @WillingCarol 57
    https://frankieflood.blogspot.com/search/label/viola%20bow%20holder https://3dprint.nih.gov
    

    View Slide

58. @WillingCarol 58
    Value
    creation
    The Impact of Open Information
    

    View Slide

59. @WillingCarol
    win - win - $$$
    59
    The Impact of Open Information
    https://boldandopen.com
    

    View Slide

60. @WillingCarol 60
    Collaborating for a cure
    The Impact of Open Information
    

    View Slide

61. @WillingCarol 61
    2005
    

    View Slide

62. @WillingCarol 62
    2013
    

    View Slide

63. @WillingCarol 63
    https://simexp.github.io/vcog_hps_ad_book/intro.html
    Jupyter Book
    Binder
    Jupyter
    pandas
    scipy
    scikit learn
    matplotlib
    numpy
    seaborn
    The Impact of Open Information
    Canadian Open Neuroscience Platform
    

    View Slide

64. @WillingCarol
    Act intentionally
    64
    

    View Slide

65. @WillingCarol
    Choose always open
    information by default
    65
    

    View Slide

66. @WillingCarol 66
    Avoid opaque
    information
    

    View Slide

67. @WillingCarol
    Proceed cautiously
    with pseudo-open
    projects
    67
    

    View Slide

68. @WillingCarol
    Plan
    Execute
    Change
    68
    https://jupyterhub-team-compass.readthedocs.io
    https://github.com/jupyterhub/team-compass
    

    View Slide

69. @WillingCarol
    Money, Money, Money
    69
    

    View Slide

70. @WillingCarol
    Read
    70
    

    View Slide

71. @WillingCarol
    Good: Use open source without investment
    Better: Make a "public relations"-driven
    minimal viable investment
    Best: Contribute an ethical amount of your
    gained value back ($, resources, personnel)
    71
    Business and industry
    Choose your own open source adventure
    

    View Slide

72. @WillingCarol
    1. Make your project citable (JOSS, JOSE)
    2. Measure your project's impact on discovery
    3. Develop best practices on soliciting funding
    from philanthropies, grants, and industry
    4. Practice self care to avoid burnout alligators
    72
    Project maintainers
    Choose your own adventure
    

    View Slide

73. @WillingCarol
    Extract the hidden value in
    obvious insights
    73
    I would never have predicted that meeting a single
    person who benefitted from your work could be
    enough to double your effort and triple your
    productivity.
    Adam Grant - Sloan SMR Spring 2019
    Adam Grant
    

    View Slide

74. @WillingCarol 74
    Focus on your impact
    

    View Slide

75. @WillingCarol
    2024
    75
    

    View Slide

76. @WillingCarol 76
    Uncertainty
    

    View Slide

77. @WillingCarol 77
    Information
    Always Open
    Learning and Discovery
    

    View Slide

78. @WillingCarol 78
    

    View Slide

79. @WillingCarol 79
    Thank you
    

    View Slide

80. @WillingCarol 80
    Thank you
    SciPy 2019 Organizers
    Project Jupyter Team
    Min Ragan-Kelly
    

    View Slide

81. @WillingCarol
    Attributions
    81
    TODO: Add slide by slide references to published research, projects, and
    drawings
    [21] Media links
    [25] Drawing by Karen Rustad
    [59] Art by Amy Davis Roth, used with permission
    Photos
    [2, 3, 4, 5, 6, 7, 45, 55, 56, 62, 67, 68, 70] Carol Willing and Linnea Willing
    [22] Octel Communications Corporation
    [38] The Carpentries, Tracy Teal, Bérénice Batut
    [53] NIH
    

    View Slide

82. @WillingCarol
    Additional content on
    learning
    82
    

    View Slide

83. Engineering Possibilities in College
    

    View Slide

84. View Slide

85. Solution
    https://github.com/willingc/epic-interactive
    https://speakerdeck.com/willingc/interactivity-in-computer-science
    

    View Slide

86. https://willingc.github.io/epic-site/
    

    View Slide

87. View Slide

88. View Slide