Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
What academia can learn from open source
Search
Arfon Smith
October 22, 2014
Science
220
1
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
What academia can learn from open source
My slides from All Things Open -
http://allthingsopen.org/
Arfon Smith
October 22, 2014
Transcript
167 slides
What Academia Can Learn from Open Source Creative Commons Attribution
3.0 Unported License Arfon Smith
[email protected]
@arfon "
!
What is a GitHub?
None
None
None
None
None
None
None
A story from my life (10 years ago)
Astronomer
tl;dr - technical, but brimming with inefficiencies
http://www.flickr.com/photos/blachswan
http://www.flickr.com/photos/esoastronomy/
http://www.flickr.com/photos/esoastronomy/ http://www.flickr.com/photos/jamiegilbert
http://amandabauer.blogspot.com/
None
None
Diffraction grating Telescope Detector
None
None
None
None
None
130 130 1 2048 189 189 258 258 480 562
378 378 493 521 390 397 851 851 247 274 319 319 304 580 493 511 610 636 188 188 228 228 > cat bad_pix_mask.txt
Wasteful
Wasteful 2 days work
Wasteful 2 days work 3 observing runs/week
Wasteful 2 days work 3 observing runs/week 52 weeks in
year
Wasteful 2 days work 3 observing runs/week 52 weeks in
year 15 year detector lifetime
Wasteful 2 days work 3 observing runs/week 52 weeks in
year 15 year detector lifetime 2*3*52*15 = 4680 days (13 years)
Wasteful… but the norm 2 days work 3 observing runs/week
52 weeks in year 15 year detector lifetime 2*3*52*15 = 4680 days (13 years)
A second story from my life (2 months ago)
None
None
None
None
None
None
Software composed of many components
Your software is the thing that is different
Open Source: Ubiquitous culture of reuse
Why isn’t academia like this?
None
None
http://dx.doi.org/ 10.1051/0004-6361
Careers are based on paper counts
Careers are based on paper citations
Three major problems
1. ’Novel’ results preferred
2. Reduced collaboration
3. The format sucks
None
Explain what you did
So that others can repeat
Everybody learns
It’s the way that we explain that matters most
None
State of the art technology
State of the art technology… for the late 17th century*
* Michael Nielsen
None
Data, methods, prose
http://www.nature.com/news/2011/111005/full/478026a.html
BIG SCIENCE
None
None
None
Complex stuff Numbers, data Science!
Reproducibility Data intensive
Verification may take years (if at all)
None
What do open source collaborations do well?
Open source collaborations Open Source vs Open Collaborations
Open source collaborations Open Source: the right to modify, not
the right to contribute.
Open source collaborations Open Collaborations: a highly collaborative development process
and are receptive to contributions of code, documentation, discussion, etc from anyone who shows competent interest.
Open source collaborations Open Collaborations: a highly collaborative development process
and are receptive to contributions of code, documentation, discussion, etc from anyone who shows competent interest. THIS
Ubiquitous culture of reuse
Expose their collaborative process
How do 4000 people work together?
The pull request
None
None
None
None
None
None
None
discuss improve Code first, permission later
Every time this happens the community learns
None
None
None
None
Merged pull requests
None
None
“open source is… reproducible by necessity” Fernando Perez http://blog.fperez.org/2013/11/an-ambitious-experiment-in-data-science.html
Better at collaborating because they have to be
(doesn’t have to mean this) Open Public? =
‘Open Source’ way of working
Open (within your team, department or institution)
Electronic & Available
Asynchronous, exposed process
Lock-free
Low friction collaboration
Academia can learn from open source
Academia must learn from open source
None
What’s happening in academia today?
Collaboration around code
None
None
None
None
None
Collaborative authoring
None
None
Collaborative teaching
None
None
None
Where might more significant change happen?
Where do communities form?
Around a shared challenge?
Around shared data?
None
10 ? n Level 1 (continual) Level 2 (periodic)
Supernovae Weak lensing Active Galactic Nuclei Solar System Galaxies Transients/variable
stars Large-scale structure Stars, Milky Way Strong lensing Informatics and Statistics Dark Energy (DESC)
None
Software composed of many components
Your software should be the thing that is different
science too! Your software should be the thing that is
different
Scientific data is becoming more open
http://www.nature.com/news/2011/111005/full/478026a.html
How do we make this behaviour the norm?
Credit
“Academic environments of today do not reward tool builders” Ed
Lazowska, OSTP event http://lazowska.cs.washington.edu/MS/MS.OSTP.pdf
None
None
None
None
None
None
None
None
“publishing a paper about code is basically just advertising” David
Donoho http://www.stanford.edu/~vcs/Video.html
None
How to derive meaningful metrics from open contributions?
None
Trust
None
None
None
None
None
Discoverability
None
Barriers are cultural, not technical
Why should we care?
Because we paid for it?
Because open=good?
Because care about the creation of knowledge?
Open source has solved much of what academia needs
Our challenge is to adapt and evolve the academy in
this new collaborative age
Thanks
[email protected]
@arfon "
More Decks by Arfon Smith
See All by Arfon Smith
Where does the rigor go? Research software and the future of trustworthy science.
arfon
0
420
Why Generative AI makes collaborative, versioned science more important than ever
arfon
0
130
Generative AI is here: What are we going to do about it?
arfon
0
240
Five principles for building generative AI products
arfon
0
200
Five principles for building generative AI products
arfon
0
290
Learning from NASA's commitment to open
arfon
0
140
JOSS rOpenSci presentation
arfon
0
350
Five ways to use GitHub to automate scholarly work
arfon
0
180
Journal of Open Source Software: Bot-assisted community peer-review
arfon
0
160
Other Decks in Science
See All in Science
摂理と合理の肉体改造 — AI時代の減量を支える観測・制御・継続
kiyoshi
0
3.8k
Biohub - Cell Tracking During Development - 3rd Place Solution
yu4u
3
680
バランスって大事だね
akasan
1
170
JPA2026_NetworkSymposium_Kashihara
junkashihara
0
130
Cross-Media Technologies, Information Science and Human-Information Interaction
signer
PRO
3
33k
Leitner Inauguration Lecture Chalmers University of Technology
xleitix
0
410
不動産業界における業界特化のデータ整備とAI活用 ─Vertical DataとVertical AI─
estie
1
1.2k
白金鉱業Meetup Vol.25 【初学者向け発表枠】「で、この施策って効いてるの」に答える効果検証の基礎 ~ATE / ATT / CATE / LATEを現場の問いに翻訳する~
brainpadpr
1
450
Path integral polarons for real semiconductors
jarvist
0
130
AWS WAFのAIトラフィック収益化機能を考えてみる_20260626
masakiokuda
1
140
Sunday Math Party 36 - Operate with Operate
butchi
0
110
AI(人工知能)の過去・現在・未来 ~AIは人類を越えるのか~
tagtag
PRO
0
190
Featured
See All Featured
Deep Space Network (abreviated)
tonyrice
0
420
Building Better People: How to give real-time feedback that sticks.
wjessup
371
20k
Pawsitive SEO: Lessons from My Dog (and Many Mistakes) on Thriving as a Consultant in the Age of AI
davidcarrasco
1
300
Making the Leap to Tech Lead
cromwellryan
135
10k
Docker and Python
trallard
47
4.3k
WCS-LA-2024
lcolladotor
0
1k
Reflections from 52 weeks, 52 projects
jeffersonlam
356
22k
Practical Orchestrator
shlominoach
192
12k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
133
20k
Efficient Content Optimization with Google Search Console & Apps Script
katarinadahlin
PRO
1
990
Collaborative Software Design: How to facilitate domain modelling decisions
baasie
1
380
Evolving SEO for Evolving Search Engines
ryanjones
0
360