Open Research + Reproducibility

Open Research + Reproducibility

Presentation given at UW Libraries, February 2017.

64ae9936d30bfe1f029b7e3fa1be486a?s=128

Brianna Marshall

February 15, 2017
Tweet

Transcript

  1. Brianna Marshall, Digital Curation Coordinator Open Research + Reproducibility

  2. About these workshops Funder Public Access Requirements Wed, Oct. 12,

    2:00-3:30 at Steenbock Thurs, Oct. 13, 9:30-11:00 at Memorial Research Data Management & Sharing Wed, Nov. 16, 2:00-3:30 at Steenbock Thurs, Nov. 17, 9:30-11:00 at Memorial Open Access Publishing Wed, Dec. 14, 2:00-3:30 at Steenbock Thurs, Dec. 15, 9:30-11:00 at Memorial Open Research & Reproducibility Wed, Feb. 15, 2:00-3:30 at Steenbock Thurs, Feb 16, 9:30-11:00 at Memorial Authors’ Rights Management Wed, Mar. 15, 2:00-3:30 at Steenbock Thurs, Mar. 16, 9:30-11:00 at Memorial TBD Wed, Apr. 12, 2:00-3:30 at Steenbock Thurs, Apr. 13, 9:30-11:00 at Memorial Library administration effort to support staff work and development around these topics
  3. Scope •  What is open research? •  The why and

    how of open research •  Open research techniques and tools •  Openness examples
  4. what’s up with researchers? Ample technology to generate data but

    few skills to manage it effectively Movement toward openness, impacted by OSTP and spurred by early career researcher expectations Disciplinary culture shifts toward data reuse + reproducibility Need for multi-purpose online spaces to collaborate, share, store, and archive research outputs (including data)
  5. research is increasingly digital. •  Multi-institutional •  Grant-funded •  Shared

    infrastructure •  Computationally driven Image courtesy of #wocintechchat
  6. open research vs. open access

  7. Image courtesy of John McKiernan, whyopenresearch.org (CC BY)

  8. Image courtesy of Flickr user usoceangov (CC BY)

  9. open workflows h4ps://innoscholcomm.silk.co/page/Open-Science

  10. open peer review

  11. http://www.shawnaross.com/2017/02/02/cfp-hacking-the-scholarly-workflow-mla-2018/

  12. https://twitter.com/ctitusbrown/status/821784837149184001

  13. [ retraction watch.com ]

  14. Aspects of Open Research •  Project management •  Data management

    •  Workflows •  Tracking myriad outputs •  Collaboration
  15. open research + reproducibility

  16. Munafo et al. (2017) A manifesto for reproducible science. Nature.

    Why is reproducibility a problem?
  17. https://osf.io/ezcuj/

  18. Reproducibility project insights •  Original teams shared materials, methods, and

    data •  Replications preregistered protocols openly •  Data, materials, and code shared by replication teams From Erin McKiernan, “Sharing in Science.” (CC BY)
  19. •  Version control •  Dynamic documents •  Building from source

    From Pierce Edmiston: github.com/pedmiston/reproducible-research
  20. perks for researchers interested in making their work open

  21. http://whyopenresearch.org/

  22. find collaborators!

  23. describing openness “For me, openness means an honesty about the

    messiness of research and transparency in methods and process that helps both the researcher and the audience. It helps the researcher by allowing others to comment and get involved in the research earlier if they spot flaws in the methodology or process, and the audience by showing (especially junior or first-time researchers) that research is rarely a clean progression from simply-defined goals to a final research output, and instead involves reworking and change as certain aspects of the originally-scoped research may become untenable or new areas prove to be more interesting or researchable.” –Thomas King, Open Research course participant https://courses.p2pu.org/he/courses/2377/content/4682/
  24. six laws of open research 1.  All data are open

    and all ideas are shared. 2.  Anyone can take part at any level. 3.  There will be no patents. 4.  Suggestions are the best form of criticism. 5.  Public discussion is much more valuable than private email. 6.  An open project is bigger than, and is not owned by, any given lab. opensourcemalaria.org
  25. how to be open •  Share your process – Documentation – Notes,

    drafts, etc. – Preregister your project •  Share your outputs – Publications – Data
  26. open dissemination •  Create a project identity on various tools

    •  Make the project blog the core part of our project identity •  Share research progress, outputs and methods on a regular basis, via our website/ blogs and other media •  Share data openly, including survey results •  Share methodology and research instruments under a CC-BY license Adapted from Open Research Course, “Examples of Open Dissemination.” https://courses.p2pu.org/he/courses/2377/content/4695/
  27. tools supporting open dissemination •  Social networks – Personal – Academic • 

    Repositories •  Collaboration platforms •  Portfolios/personal websites
  28. open access open dissemination open licensing open attitudes

  29. Image courtesy of: https://courses.p2pu.org/he/courses/ 2377/open-research-2014/ openness examples

  30. KARL BROMAN @kbroman Department of Biostatistics & Medical Informatics UW-Madison

  31. None
  32. steps toward reproducible research –  Everything with a script – 

    Organize your data and code –  Automate the process –  Turn scripts into reproducible reports –  Turn repeated code into functions –  Package functions for reuse –  Use version control –  License your software Note: These steps apply primarily to computational research. http://kbroman.org/steps2rr/
  33. ERIN MCKIERNAN @emckiernan13 Postdoctoral Fellow, Neuroscience Wilfrid Laurier University

  34. erin’s openness pledge I pledge to: –  edit and review

    only for open access journals –  publish only in open access journals –  openly share my working manuscripts –  openly share my code, when possible –  openly share my data, when possible –  openly share my notebooks, when possible –  ask my professional societies to support open research –  speak out in support of open research
  35. https://www.youtube.com/watch?v=h4jWAj6Ji08 learn more about erin’s pledge

  36. JOHN HAWKS @johnhawks Vilas-Borghesi Distinguished Achievement Professor of Anthropology UW-Madison

  37. [ http://elifesciences.org/content/4/e09560 ]

  38. - Denne Reed, Homo Naledi team [ http://www.nature.com/news/crowdsourcing-digs-up-an-early-human-species-1.18305 ] “We’re

    more interested in openly sharing data… the advantages in collaboration far outweigh any of the risks.”
  39. and from the flip side…

  40. None
  41. “The investigators collected their samples, returned home and published the

    startling results in European medical journals. Few Liberians were then trained in laboratory or epidemiological methods. Even today, downloading one of the papers would cost a physician here $45, about half a week’s salary. …To our knowledge, no senior official now serving in Liberia’s Ministry of Health had ever heard of the antibody studies’ findings. Nor had top officials in the international organizations so valiantly supporting the Ebola response in Liberia, including United Nations agencies and foreign medical teams.” - BERNICE DAHN, VERA MUSSAH and CAMERON NUTT http://www.nytimes.com/2015/04/08/opinion/yes-we-were-warned-about-ebola.html
  42. Open Research + Libraries CU Boulder – Open and Digital

    Scholarship Services University of Cambridge Open Research pilot
  43. What We Can Do Be proactive supporters of open research

    beyond enforcing compliance. How? •  Immerse ourselves in the tools •  Help bridge the technical skills gap •  Create targeted programming •  Partner with existing platforms
  44. What We Can Do Right Now! Immerse ourselves in the

    tools •  Familiarize yourself with the Open Science Framework, Authorea, Jupyter notebooks, and R. Help bridge the technical skills gap •  Library involvement and leadership in Software Carpentry and Data Carpentry. Create targeted programming •  Presentations and workshops on open research related topics. Partner with existing platforms •  OSF for Institutions! Further library commitment to LabArchives.
  45. •  Open Science Framework •  Preregistering research •  Preprints • 

    SHARE collaboration
  46. OSF for institutions

  47. workflow consultations https://innoscholcomm.silk.co/page/'Follow-the-crowd'

  48. Image used courtesy of Michelle Craft, Wisconsin Institute of Discovery

    at UW-Madison
  49. Image used courtesy of Flickr user feuilllu (CC BY)

  50. resources

  51. whyopenresearch.org

  52. open research course https://courses.p2pu.org/he/courses/2377/open-research-2014/

  53. discussion points •  What do you think is the future

    of open research and libraries? •  What do you want to learn about open research and reproducibility? What are you most curious about? •  What are good strategies for engaging departments in discussion on these topics?