Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Web Scale Collaborations
Search
Arfon Smith
December 10, 2013
Science
90
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Web Scale Collaborations
Arfon Smith
December 10, 2013
More Decks by Arfon Smith
See All by Arfon Smith
Where does the rigor go? Research software and the future of trustworthy science.
arfon
0
410
Why Generative AI makes collaborative, versioned science more important than ever
arfon
0
120
Generative AI is here: What are we going to do about it?
arfon
0
240
Five principles for building generative AI products
arfon
0
200
Five principles for building generative AI products
arfon
0
280
Learning from NASA's commitment to open
arfon
0
140
JOSS rOpenSci presentation
arfon
0
340
Five ways to use GitHub to automate scholarly work
arfon
0
170
Journal of Open Source Software: Bot-assisted community peer-review
arfon
0
160
Other Decks in Science
See All in Science
機械学習 - K-means & 階層的クラスタリング
trycycle
PRO
0
2.3k
知能とはなにか -ヒトとAIのあいだ-
tagtag
PRO
0
180
CVPR2026_VGGTとその仲間たち
mickey_0226
0
1.3k
TypeScript で WebAssembly を用いた 型安全なプラグイン設計
nagano
3
690
生成AI時代のインタラクションサイエンス(招待講演)/interaction-science
okana2ki
0
120
データベース08: 実体関連モデルとは?
trycycle
PRO
0
1.7k
現代AI入門: 大規模言語モデルから思考するシステムへ — Test-Time Scaling, Loop, Harness, RSI
stillpedant
PRO
47
24k
不動産業界における業界特化のデータ整備とAI活用 ─Vertical DataとVertical AI─
estie
1
1.1k
社内で活躍できるデータサイエンティストになるために
aikinohara
1
200
機械学習 - ニューラルネットワーク入門
trycycle
PRO
0
1.4k
J-STAGE全文XML登載必須化について
xspa2012
0
1.7k
20260820_アウトカムが二値のデータに対するCausal Impact@LINEヤフー Data Science Share #2 / Causal Impact for Binary Outcomes
brainpadpr
3
1.6k
Featured
See All Featured
Designing for Performance
lara
612
70k
Facilitating Awesome Meetings
lara
57
7.2k
Large-scale JavaScript Application Architecture
addyosmani
516
110k
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
ryanjones
0
290
The Cost Of JavaScript in 2023
addyosmani
56
10k
Navigating the Design Leadership Dip - Product Design Week Design Leaders+ Conference 2024
apolaine
2
510
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
37
6.7k
The Straight Up "How To Draw Better" Workshop
denniskardys
239
140k
The Limits of Empathy - UXLibs8
cassininazir
2
760
Designing Powerful Visuals for Engaging Learning
tmiket
1
650
ReactJS: Keep Simple. Everything can be a component!
pedronauck
666
130k
Navigating the moral maze — ethical principles for Al-driven product design
skipperchong
2
680
Transcript
Web Scale Collaborations Arfon Smith @arfon
Citizen Science
Distributed Computing
None
Distributed Data Collection
None
None
Distributed Analysis
None
None
None
None
http://www.novacelestia.com
None
None
None
None
None
0 250,000 500,000 750,000 1,000,000 Professor Paper PhD SDSS
Classifications per hour 0 10,000 20,000 30,000 40,000 50,000 60,000
70,000 Hours 0 6 12 18 24 30 36 42 48 1 Kevin months Fukugita et al. 2007
None
None
None
None
None
None
None
None
None
SDSS HST Starforming pea Narrow-line Seyfert pea
None
None
None
None
None
None
None
Motivations
None
None
None
1,000,000,000,000 hours / year
Spectrum of cognitive surplus
None
None
Begins with open data
Open Source
Not treating code and data as first class research objects
GitHub
What is a GitHub?
None
None
None
None
Easier to work together than alone
Open Source collaboration
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
Open Public ≠
Open (within your team, department or institution)
Electronic
Available
Asynchronous
Lock-free
None
None
None
Low friction collaboration
“open source is… reproducible by necessity” Fernando Perez http://blog.fperez.org/2013/11/an-ambitious-experiment-in-data-science.html
Better at collaborating because they have to be
Towards Collaborative Versioned Science
How do we make this behaviour the norm?
Incentive model (it’s broken)
Credit
http://dx.doi.org/10.6084/m9.figshare.828487
http://dx.doi.org/10.6084/m9.figshare.828487
None
None
Derive meaningful metrics from open contributions
“Academic environments of today do not reward tool builders” Ed
Lazowska, OSTP event http://lazowska.cs.washington.edu/MS/MS.OSTP.pdf
A VISION AND STRATEGY FOR SOFTWARE FOR SCIENCE, ENGINEERING, AND
EDUCATION
What can we do today?
Take data management plans seriously
Try versioning your research
Share more than just data
If you’re going to share it then you better put
a licence on it
Thanks.
[email protected]
@arfon "