Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Web Scale Collaborations
Search
Arfon Smith
December 10, 2013
Science
86
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Web Scale Collaborations
Arfon Smith
December 10, 2013
More Decks by Arfon Smith
See All by Arfon Smith
Why Generative AI makes collaborative, versioned science more important than ever
arfon
0
96
Generative AI is here: What are we going to do about it?
arfon
0
210
Five principles for building generative AI products
arfon
0
160
Five principles for building generative AI products
arfon
0
260
Learning from NASA's commitment to open
arfon
0
130
JOSS rOpenSci presentation
arfon
0
320
Five ways to use GitHub to automate scholarly work
arfon
0
160
Journal of Open Source Software: Bot-assisted community peer-review
arfon
0
150
A vision for the future of astronomical archives
arfon
0
180
Other Decks in Science
See All in Science
AlgorithAlgorihms for Decision Making
mickey_kubo
0
120
不動産業界における業界特化のデータ整備とAI活用 ─Vertical DataとVertical AI─
estie
1
900
データベース03: 関係データモデル
trycycle
PRO
1
790
Build your own LLM, Live, with MicroGPT
ianozsvald
0
120
人生を変えた一冊「独学大全」のはなし / Self-study ENCYCLOPEDIA: The Book Which Change My Life #独学大全 #EM推し本
expajp
0
190
TypeScript で WebAssembly を用いた 型安全なプラグイン設計
nagano
2
590
Wet Active Matter
rajeshrinet
0
140
データベース08: 実体関連モデルとは?
trycycle
PRO
0
1.6k
バランスって大事だね
akasan
1
100
生成AI・プレプリント時代における 研究成果公開の再設計 ― トップカンファレンス文化はどこへ向かうのか / Redesigning the Dissemination of Research Outputs in the Age of Generative AI and Preprints — Where Is the Top-Conference Culture Heading?
ykiyota
0
30k
From Prediction to Understanding: Causal Discovery for Data Science and AI Applications
sshimizu2006
0
230
How a camera trap data standard enabled an ecosystem of interoperable tools
peterdesmet
0
110
Featured
See All Featured
AI: The stuff that nobody shows you
jnunemaker
PRO
9
920
Learning to Love Humans: Emotional Interface Design
aarron
275
41k
Speed Design
sergeychernyshev
33
2k
More Than Pixels: Becoming A User Experience Designer
marktimemedia
3
490
Kristin Tynski - Automating Marketing Tasks With AI
techseoconnect
PRO
0
470
KATA
mclloyd
PRO
35
15k
Visual Storytelling: How to be a Superhuman Communicator
reverentgeek
2
610
How Software Deployment tools have changed in the past 20 years
geshan
1
34k
sira's awesome portfolio website redesign presentation
elsirapls
0
320
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
49
10k
Designing Experiences People Love
moore
143
24k
Side Projects
sachag
455
43k
Transcript
Web Scale Collaborations Arfon Smith @arfon
Citizen Science
Distributed Computing
None
Distributed Data Collection
None
None
Distributed Analysis
None
None
None
None
http://www.novacelestia.com
None
None
None
None
None
0 250,000 500,000 750,000 1,000,000 Professor Paper PhD SDSS
Classifications per hour 0 10,000 20,000 30,000 40,000 50,000 60,000
70,000 Hours 0 6 12 18 24 30 36 42 48 1 Kevin months Fukugita et al. 2007
None
None
None
None
None
None
None
None
None
SDSS HST Starforming pea Narrow-line Seyfert pea
None
None
None
None
None
None
None
Motivations
None
None
None
1,000,000,000,000 hours / year
Spectrum of cognitive surplus
None
None
Begins with open data
Open Source
Not treating code and data as first class research objects
GitHub
What is a GitHub?
None
None
None
None
Easier to work together than alone
Open Source collaboration
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
Open Public ≠
Open (within your team, department or institution)
Electronic
Available
Asynchronous
Lock-free
None
None
None
Low friction collaboration
“open source is… reproducible by necessity” Fernando Perez http://blog.fperez.org/2013/11/an-ambitious-experiment-in-data-science.html
Better at collaborating because they have to be
Towards Collaborative Versioned Science
How do we make this behaviour the norm?
Incentive model (it’s broken)
Credit
http://dx.doi.org/10.6084/m9.figshare.828487
http://dx.doi.org/10.6084/m9.figshare.828487
None
None
Derive meaningful metrics from open contributions
“Academic environments of today do not reward tool builders” Ed
Lazowska, OSTP event http://lazowska.cs.washington.edu/MS/MS.OSTP.pdf
A VISION AND STRATEGY FOR SOFTWARE FOR SCIENCE, ENGINEERING, AND
EDUCATION
What can we do today?
Take data management plans seriously
Try versioning your research
Share more than just data
If you’re going to share it then you better put
a licence on it
Thanks.
[email protected]
@arfon "