Slide 1

Slide 1 text

reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu reproducible research ideas and solutions for actually doing it Dave Lunt June 2016 dave.lunt@gmail.com Labchat is reproducible, all resources are at: https://osf.io/cqb6x/

Slide 2

Slide 2 text

http://xkcd.com/ reproducible research is science

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

Reproducibility makes your life much easier ‘future you’ will reproduce your work reproducibility gives you new experimental ‘powers’ carrot not stick

Slide 6

Slide 6 text

reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu small wins remember past successes tolerate minor inconvenience iterate know your issues don’t reinvent the wheel do something now implementing reproducibility

Slide 7

Slide 7 text

reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu tolerate minor inconvenience remember past successes small wins don’t reinvent the wheel do something now know your issues iterate What do you want from reproducibility?

Slide 8

Slide 8 text

reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu tolerate minor inconvenience remember past successes small wins don’t reinvent the wheel do something now know your issues iterate What do you want from reproducibility? OK, now be more ambitious...

Slide 9

Slide 9 text

ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGAACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATG ATCGACTACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATAC GATCGATCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAAT CGAGCGACACGAACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGA TCGATGATCGACTACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCG ATATACGATCGATCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGA TCGAATCGAGCGACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG collaboration archiving credibility backup provenance ease publication

Slide 10

Slide 10 text

reproducibility environments what you should use

Slide 11

Slide 11 text

reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu git osf docker jupyter figshare galaxy Protocols.io

Slide 12

Slide 12 text

reproducibility environments Things that work for starting out reducing reproducibility friction

Slide 13

Slide 13 text

reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu git osf docker jupyter figshare galaxy Protocols.io

Slide 14

Slide 14 text

https://osf.io

Slide 15

Slide 15 text

No content

Slide 16

Slide 16 text

http://osf.io OSF is imperfect but very workable small wins remember past successes tolerate minor inconvenience iterate know your issues don’t reinvent the wheel do something now

Slide 17

Slide 17 text

http://osf.io OSF is imperfect but very workable small wins remember past successes tolerate minor inconvenience iterate know your issues don’t reinvent the wheel do something now Its pretty good actually, easy to use You could start today, achieve small wins

Slide 18

Slide 18 text

https://osf.io/cqb6x/ live demo

Slide 19

Slide 19 text

http://protocols.io Protocols are open cc-by Protocols have doi

Slide 20

Slide 20 text

No content

Slide 21

Slide 21 text

No content

Slide 22

Slide 22 text

No content

Slide 23

Slide 23 text

reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu small wins remember past successes tolerate minor inconvenience iterate know your issues don’t reinvent the wheel do something now know your issues, start small, and do something now [the end]