Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Web Scale Collaborations

Avatar for Arfon Smith Arfon Smith
December 10, 2013
Science
88
0

Web Scale Collaborations

Avatar for Arfon Smith

Arfon Smith

December 10, 2013

More Decks by Arfon Smith

See All by Arfon Smith
Where does the rigor go? Research software and the future of trustworthy science.
Avatar for Arfon Smith arfon
0
360
Why Generative AI makes collaborative, versioned science more important than ever
Avatar for Arfon Smith arfon
0
110
Generative AI is here: What are we going to do about it?
Avatar for Arfon Smith arfon
0
230
Five principles for building generative AI products
Avatar for Arfon Smith arfon
0
180
Five principles for building generative AI products
Avatar for Arfon Smith arfon
0
270
Learning from NASA's commitment to open
Avatar for Arfon Smith arfon
0
140
JOSS rOpenSci presentation
Avatar for Arfon Smith arfon
0
340
Five ways to use GitHub to automate scholarly work
Avatar for Arfon Smith arfon
0
170
Journal of Open Source Software: Bot-assisted community peer-review
Avatar for Arfon Smith arfon
0
160

Other Decks in Science

See All in Science
データベース11: 正規化(1/2) - 望ましくない関係スキーマ
Avatar for Y. Yamamoto trycycle
PRO
0
1.8k
データベース04: SQL (1/3) 単純質問 & 集約演算
Avatar for Y. Yamamoto trycycle
PRO
0
1.8k
How a camera trap data standard enabled an ecosystem of interoperable tools
Avatar for Peter Desmet peterdesmet
0
140
SAT ソルバーの仕組みと制約ソルバーへの応用
Avatar for tsoh tsoh
3
670
ゲームと人工知能
Avatar for miyayou miyayou
0
260
Collective Predictive Coding Hypothesis: Emergence of Language and Cooperative Behaviors
Avatar for Tadahiro Taniguchi tanichu
0
110
JSAI2026企画セッションKS-14 インタビュー集『⼈⼯知能と哲学と四つの問い』が提起する⼈⼯知能のこれからの課題 趣旨説明 / JSAI2026 Special Session: A Collection of Interviews, “Artificial Intelligence, Philosophy, and Four Questions”
Avatar for Kiyota Yoji, Ph.D. ykiyota
0
470
HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Maps
Avatar for Aki Teshima tomoaki0705
0
170
知能とはなにか　－ヒトとAIのあいだ－
Avatar for Y-h. Taguchi tagtag
PRO
0
230
AI(人工知能）の過去・現在・未来　～AIは人類を越えるのか～
Avatar for Y-h. Taguchi tagtag
PRO
0
170
生成AI・プレプリント時代における 研究成果公開の再設計 ― トップカンファレンス文化はどこへ向かうのか / Redesigning the Dissemination of Research Outputs in the Age of Generative AI and Preprints — Where Is the Top-Conference Culture Heading?
Avatar for Kiyota Yoji, Ph.D. ykiyota
0
30k
AWS WAFのAIトラフィック収益化機能を考えてみる_20260626
Avatar for モブエンジニア（Masaki Okuda） masakiokuda
1
110

Featured

See All Featured
How to Talk to Developers About Accessibility
Avatar for Jason CranfordTeague jct
2
570
Done Done
Avatar for chrislema chrislema
187
17k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
1.2k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
3
1.3k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
41k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
77
5.6k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
28
3.7k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
220
The Director’s Chair: Orchestrating AI for Truly Effective Learning
Avatar for Mike Taylor tmiket
1
330
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
35k
技術選定の審美眼（2025年版） / Understanding the Spiral of Technologies 2025 edition
Avatar for Takuto WADA twada
PRO
120
120k
Designing for Timeless Needs
Avatar for Cassini Nazir cassininazir
1
520

Transcript

  1. Web Scale Collaborations Arfon Smith @arfon

  2. Citizen Science

  3. Distributed Computing

  4. None

  5. Distributed Data Collection

  6. None
  7. None

  8. Distributed Analysis

  9. None
  10. None
  11. None
  12. None

  13. http://www.novacelestia.com

  14. None
  15. None
  16. None
  17. None
  18. None

  19. 0 250,000 500,000 750,000 1,000,000 Professor Paper PhD SDSS

  20. Classifications per hour 0 10,000 20,000 30,000 40,000 50,000 60,000

    70,000 Hours 0 6 12 18 24 30 36 42 48 1 Kevin months Fukugita et al. 2007
  21. None
  22. None
  23. None
  24. None
  25. None
  26. None
  27. None
  28. None
  29. None

  30. SDSS HST Starforming pea Narrow-line Seyfert pea

  31. None
  32. None
  33. None
  34. None
  35. None
  36. None
  37. None

  38. Motivations

  39. None
  40. None
  41. None

  42. 1,000,000,000,000 hours / year

  43. Spectrum of cognitive surplus

  44. None
  45. None

  46. Begins with open data

  47. Open Source

  48. Not treating code and data as first class research objects

  49. GitHub

  50. What is a GitHub?

  51. None
  52. None
  53. None
  54. None

  55. Easier to work together than alone

  56. Open Source collaboration

  57. None
  58. None
  59. None
  60. None
  61. None
  62. None
  63. None
  64. None
  65. None
  66. None
  67. None
  68. None
  69. None
  70. None
  71. None
  72. None

  73. Open Public ≠

  74. Open (within your team, department or institution)

  75. Electronic

  76. Available

  77. Asynchronous

  78. Lock-free

  79. None
  80. None
  81. None

  82. Low friction collaboration

  83. “open source is… reproducible by necessity” Fernando Perez http://blog.fperez.org/2013/11/an-ambitious-experiment-in-data-science.html

  84. Better at collaborating because they have to be

  85. Towards Collaborative Versioned Science

  86. How do we make this behaviour the norm?

  87. Incentive model (it’s broken)

  88. Credit

  89. http://dx.doi.org/10.6084/m9.figshare.828487

  90. http://dx.doi.org/10.6084/m9.figshare.828487

  91. None
  92. None

  93. Derive meaningful metrics from open contributions

  94. “Academic environments of today do not reward tool builders” Ed

    Lazowska, OSTP event http://lazowska.cs.washington.edu/MS/MS.OSTP.pdf

  95. A VISION AND STRATEGY FOR SOFTWARE FOR SCIENCE, ENGINEERING, AND

    EDUCATION

  96. What can we do today?

  97. Take data management plans seriously

  98. Try versioning your research

  99. Share more than just data

  100. If you’re going to share it then you better put

    a licence on it

  101. Thanks. [email protected] @arfon "