Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Reproducible Science

Reproducible Science

The challenge of reproducible, collaborative science in the 3rd millennium and the role of Authorea.

Matteo Cantiello

May 12, 2014
Tweet

More Decks by Matteo Cantiello

Other Decks in Science

Transcript

  1.  Is Collaborative  Produces / collects large Datasets 

    Requires large Computations/complex Codes Science in the 3rd millennium
  2. “No research paper can ever be considered to be the

    final word, and the replication and corroboration of research results is key to the scientific process” http://www.nature.com/nature/focus/reproducibility/ Reproducibility is one pillar of the scientific method. It’s what distinguish science from subjective matters. Michael Kloran What about reproducibility?
  3. Emerging Bad Practices  Tendency to publish only positive results

     Lack of duplication of “established” results  Increase number of retractions (misconduct?)  Clear cases of scientific misconducts  Clear cases of scientific frauds
  4. Data: Fanelli, D. (2010) Positive results in psychology [...] dominate

    most journals, which strive to present new, exciting research. Meanwhile, attempts to replicate those studies, especially when the findings are negative, go unpublished [...]“ There are some experiments that everyone knows don't replicate, but this knowledge doesn't get into the literature,” The publication barrier can be chilling: “I've seen students spending their entire PhD period trying to replicate a phenomenon, failing, and quitting academia because they had nothing to show for their time.” Ed Yong, Nature 485, 7398 ” “
  5. Drivers / Players?  Publication Pressure  Role of journals

    / media  Peer review system  Dissemination format of scientific results not allowing full reproducibility
  6. “Central to this initiative is a checklist intended to prompt

    authors to disclose technical and statistical information in their submissions [...] To further increase transparency, we will encourage authors to provide tables of the data behind graphs and figures” http://www.nature.com/news/announcement-reducing-our-irreproducibility-1.12852 Nature, 2013 Reducing our Irreproducibility
  7. written up on 20th century tools packaged in a 17th

    century format Scientists produce 21st century research