Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Scaling Science
Search
Matt Wood
November 21, 2012
Science
3
460
Scaling Science
Introducing five principles for reproducibility.
Matt Wood
November 21, 2012
Tweet
Share
More Decks by Matt Wood
See All by Matt Wood
Field Notes from Expeditions in the Cloud
mza
2
360
A Platform for Big Data
mza
6
720
The Data Lifecycle
mza
5
470
Provision Throughput Like a Boss
mza
0
410
Impact of Cloud Computing: Life Sciences
mza
2
820
Latency's Worst Nightmare: Performance Tuning Tips and Tricks
mza
4
1.1k
Under the Covers of DynamoDB
mza
4
980
From Analytics to Intelligence: Amazon Redshift
mza
9
960
High Performance Web Applications
mza
6
600
Other Decks in Science
See All in Science
Tensor Representations in Signal Processing and Machine Learning (Tutorial at APSIPA-ASC 2020)
yokotatsuya
0
110
[第62回 CV勉強会@関東] Long-CLIP: Unlocking the Long-Text Capability of CLIP / kantoCV 62th ECCV 2024
lychee1223
1
830
メール送信サーバの集約における透過型SMTP プロキシの定量評価 / Quantitative Evaluation of Transparent SMTP Proxy in Email Sending Server Aggregation
linyows
0
650
生成AI による論文執筆サポートの手引き(ワークショップ) / A guide to supporting dissertation writing with generative AI (workshop)
ks91
PRO
0
390
機械学習を支える連続最適化
nearme_tech
PRO
1
240
統計的因果探索: 背景知識とデータにより因果仮説を探索する
sshimizu2006
3
640
科学で迫る勝敗の法則(名城大学公開講座.2024年10月) / The principle of victory discovered by science (Open lecture in Meijo Univ. 2024)
konakalab
0
260
化学におけるAI・シミュレーション活用のトレンドと 汎用原子レベルシミュレーター: Matlantisを使った素材開発
matlantis
0
430
04_石井クンツ昌子_お茶の水女子大学理事_副学長_D_I社会実現へ向けて.pdf
sip3ristex
0
120
Iniciativas independentes de divulgação científica: o caso do Movimento #CiteMulheresNegras
taisso
0
930
FOGBoston2024
lcolladotor
0
150
240510 COGNAC LabChat
kazh
0
180
Featured
See All Featured
Fontdeck: Realign not Redesign
paulrobertlloyd
83
5.4k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
7
630
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
6
550
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.4k
It's Worth the Effort
3n
184
28k
Bash Introduction
62gerente
611
210k
Adopting Sorbet at Scale
ufuk
74
9.2k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
The Straight Up "How To Draw Better" Workshop
denniskardys
232
140k
A Tale of Four Properties
chriscoyier
158
23k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
33
2.8k
Transcript
Scaling Science matthew@amazon.com Dr. Matt Wood
Hello
Science
Beautiful, unique.
Impossible to re-create
Snowflake Science
Reproducibility
Reproducibility scales science
Reproduce. Reuse. Remix.
Value++
None
How do we get from here to there? 5PRINCIPLES REPRODUCIBILITY
OF
1. Data has Gravity 5 PRINCIPLES REPRODUCIBILITY OF
Increasingly large data collections
1000 Genomes Project: 200Tb
Challenging to obtain and manage
Expensive to experiment
Large barrier to reproducibility
Data size will increase
Data integration will increase
Data dependencies will increase
Move data to the users
Move data to the users X
Move tools to the data
Place data where it can consumed by tools
Place tools where they can access data
None
None
None
Canonical source
None
More data, more users, more uses, more locations
Cost
Force multiplier
Cost
Complexity
Cost and complexity kill reproducibility
Utility computing
Availability
Pay-as-you-go
Flexibility
Performance
CPU + IO
Intel Xeon E5 NVIDIA Tesla GPUs
240 TFLOPS
90 - 120k IOPS on SSDs
Performance through productivity
Cost
On-demand access
Reserved capacity
100% Reserved capacity
100% Reserved capacity On-demand
100% Reserved capacity On-demand
Spot instances
Utility computing enhanced reproducibility
None
2. Ease of use is a pre-requisite 5 PRINCIPLES REPRODUCIBILITY
OF
http://headrush.typepad.com/creating_passionate_users/2005/10/getting_users_p.html
Help overcome the suck threshold
Easy to embrace and extend
Choose the right abstraction for the user
$ ec2-run-instances
$ starcluster start
None
Package and automate
Package and automate Amazon machine images, VM import
Package and automate Amazon machine images, VM import Deployment scripts,
CloudFormation, Chef, Puppet
Expert-as-a-service
None
None
1000 Genomes Cloud BioLinux
None
Your HiSeq data Illumina BaseSpace
Architectural freedom
Freedom of abstraction
3. Reuse is as important as reproduction 5 PRINCIPLES REPRODUCIBILITY
OF
Seven Deadly sins of Bioinformatics: http://www.slideshare.net/dullhunk/the-seven-deadly-sins-of-bioinformatics
Seven Deadly sins of Bioinformatics: http://www.slideshare.net/dullhunk/the-seven-deadly-sins-of-bioinformatics
Infonauts are hackers
They have their own way of working
The ‘Big Red Button’
Fire and forget reproduction is a good first step, but
limits longer term value.
Monolithic, one-stop-shop
Work well for intended purpose
Challenging to install, dependency heavy
Di cult to grok
Inflexible
Infonauts are hackers: embrace it.
Small things. Loosely coupled.
Easier to grok
Easier to reuse
Easier to integrate
Lower barrier to entry
Scale out
Build for reuse. Be remix friendly. Maximize value.
4. Build for collaboration 5 PRINCIPLES REPRODUCIBILITY OF
Workflows are memes
Reproduction is just the first step
Bill of materials: code, data, configuration, infrastructure
Full definition for reproduction
Utility computing provides a playground for bioinformatics
Code + AMI + custom datasets + public datasets +
databases + compute + result data
Code + AMI + custom datasets + public datasets +
databases + compute + result data
Code + AMI + custom datasets + public datasets +
databases + compute + result data
Code + AMI + custom datasets + public datasets +
databases + compute + result data
Package, automate, contribute.
Utility platform provides scale for production runs
Drug discovery on 50k cores: Less than $1000
5. Provenance is a first class object 5 PRINCIPLES REPRODUCIBILITY
OF
Versioning becomes really important
Especially in an active community
Doubly so with loosely coupled tools
Provenance metadata is a first class entity
Distributed provenance
1. Data has gravity 2. Ease of use is a
pre-requisite 3. Reuse is as important as reproduction 4. Build for collaboration 5. Provenance is a first class object 5PRINCIPLES REPRODUCIBILITY OF
None
Thank you aws.amazon.com @mza matthew@amazon.com