Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Reproducible Research: ideas & solutions for actually doing it

Dave Lunt
June 23, 2016

Reproducible Research: ideas & solutions for actually doing it

Labchat preentation given to EvoHull group on techniques for achieving reproducible research

Dave Lunt

June 23, 2016
Tweet

More Decks by Dave Lunt

Other Decks in Research

Transcript

  1. reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod

    ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu reproducible research ideas and solutions for actually doing it Dave Lunt June 2016 [email protected] Labchat is reproducible, all resources are at: https://osf.io/cqb6x/
  2. Reproducibility makes your life much easier ‘future you’ will reproduce

    your work reproducibility gives you new experimental ‘powers’ carrot not stick
  3. reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod

    ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu small wins remember past successes tolerate minor inconvenience iterate know your issues don’t reinvent the wheel do something now implementing reproducibility
  4. reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod

    ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu tolerate minor inconvenience remember past successes small wins don’t reinvent the wheel do something now know your issues iterate What do you want from reproducibility?
  5. reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod

    ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu tolerate minor inconvenience remember past successes small wins don’t reinvent the wheel do something now know your issues iterate What do you want from reproducibility? OK, now be more ambitious...
  6. ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGAACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATG ATCGACTACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATAC GATCGATCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAAT CGAGCGACACGAACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGA TCGATGATCGACTACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCG ATATACGATCGATCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGA TCGAATCGAGCGACACGA

    ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG ACACGA ACGTGACAGCAGCGCATAGGCTAGCGCATAGCATACGTACGATCGATGGCCANATCGATCGCGATTTAGATCGATGATCGAC TACGATCGATCATTCGATCATGCATGGCGATCTATGCGGCATTATCGAGCGATTATCGGGGATCGAGGCGATATACGATCGA TCGATCGCATCGATATCGATCGAGGATTCGACGATTGACTATCAGCGCGGCGCATATTACGATGCTACGATCGAATCGAGCG collaboration archiving credibility backup provenance ease publication
  7. reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod

    ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu git osf docker jupyter figshare galaxy Protocols.io
  8. reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod

    ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu git osf docker jupyter figshare galaxy Protocols.io
  9. http://osf.io OSF is imperfect but very workable small wins remember

    past successes tolerate minor inconvenience iterate know your issues don’t reinvent the wheel do something now
  10. http://osf.io OSF is imperfect but very workable small wins remember

    past successes tolerate minor inconvenience iterate know your issues don’t reinvent the wheel do something now Its pretty good actually, easy to use You could start today, achieve small wins
  11. reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod

    ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreproducibilityrep roducibilityreproducibilityreproducibilityreproducibilityreproducibility reproducibilityreproducibilityreproducibilityreproducibilityreproducib ilityreproducibilityreproducibilityreproducibilityreproducibilityreprod ucibilityreproducibilityreproducibilityreproducibilityreprodu small wins remember past successes tolerate minor inconvenience iterate know your issues don’t reinvent the wheel do something now know your issues, start small, and do something now [the end]