Starting 2021 Right: Good Research Data Management Practices

Españoles Científicos en USA (ECUSA) Webinar
Presented February 5, 2021

Data management is essential for responsible research and planning should be early. Well-organized and well-documented data will meet the requirements of funding agencies and institutions and help the research to be preserved, discovered, and reproducible. In this webinar Julie Goldman (BS, MLIS) Countway Research Data Services Librarian with the Harvard Library, shared with us essential practices for the management of scientific and technical data, commented on international good practices and new working models in Open Science as tools for management and knowledge sharing.

Recording: https://youtu.be/IgGDLeRjN0A

Transcript

1. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Starting 2021 Right: Good Research Data Management Practices Españoles Científicos en USA (ECUSA) Webinar Julie Goldman, Research Data Services Librarian
2. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Julie Goldman Research Data Services Librarian Countway Library julie_goldman@harvard.edu
3. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Outline ▪ Research Data Management ▪ Foundational Practices ▪ Reproducible Research ▪ Open Science Framework
4. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Research Data Management
5. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Discussion Questions How familiar are you with “Data Management”? What RDM term(s) do you have questions about? (For example: archive, metadata, repository, etc.)
6. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program “The active and ongoing management of data through its lifecycle of interest and usefulness to scholarship, science, and education.” — The University of Illinois’ Graduate School of Library and Information Science Research Data Management
7. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Data Lifecycle DATA COLLECTION PRACTICES Organize files Naming conventions Maintain documentation Project version control DATA SHARING PRACTICES Connect research Share in a repository Close out project
8. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program RDM Snafu Video
9. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Case for Data Management ▪ Follow best research practices ▪ Save time for research ▪ Avoid risk of data loss ▪ Ensure transparency and reproducibility ▪ Increase data visibility and number of citations ▪ Fulfill funders’ requirements and receive more grants ▪ Produce new knowledge and make more discoveries by re-using data ▪ Archive, retrieve and re-use data
10. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Foundational Practices
11. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Keep Sufficient Documentation Source: Cornell Research Data Management Service Group. Guide to writing "readme" style metadata template. ▪ Written at many “levels” and comes in many forms ▪ Record all the information necessary to understand the content and context of the data ▪ Stored alongside your research data such as in lab notebooks, databases, or in README Files
12. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Organize Files Systematically Source: Briney, K., Coates, H., & Goben, A. (2020). Foundational practices of research data management.
13. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Consistently Name Files Based On: Briney, K., Coates, H., & Goben, A. (2020). Foundational practices of research data management.
14. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Version Files ▪ Keep track of project across time ▪ Keep an untouched copy of the original file or raw data that won’t be overwritten! ▪ Basic: captured in file names (e.g. _v03) ▪ Intermediate: file sharing platform with version control built-in (e.g. Dropbox) ▪ Advanced: version control software (e.g. git) http://phdcomics.com/comics/archive.php?comicid=1531
15. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Create a Security Plan ▪ Protection of data subjects and intellectual property rights ▪ Continued access to data for research purposes ▪ Compliance with applicable laws, regulations and University policies ▪ Also consider ownership, ethics, retention & destruction
16. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Define Roles and Responsibilities Source: DataONE Best Practices: Define roles and assign responsibilities for data management. ▪ Data manager ▪ Data collector ▪ Data analyst ▪ Project director ▪ Computing staff ▪ Administrative support staff ▪ External data center or archive
17. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Backup Data https://blog.iinet.net.au/prepared-backup
18. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Close Out the Project Source: Biomedical Research Data Management. RDM Offboarding Checklist. ▪ Capture employees institutional knowledge ▪ Checklist to create a Knowledge Transfer File ▪ Record essential information about projects and datasets
19. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Citations Compliance Visibility tech Access Policy ▪ Repositories provide technical infrastructure to provide access and curation of research data ▪ Provide a persistent identifier and a citation for your data ▪ Provide access controls ▪ Are compliant with funders and journals requirements Put Data in a Repository
20. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Write These Conventions Down ▪ Data Management Plan: Written document outlining plans for handling all of the data resulting from a research project ▪ Detailed procedures for data collection, and all aspects of organization and processing before your data leaves your lab ▪ Plan for when data leave your lab so that others can find and access it in perpetuity ▪ Living, working document describing the entire project and is frequently referred to & updated
21. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program DMP Requirements Timeline
22. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Create a Data Management Plan ▪ Type(s) of data collected or created ▪ Data formats during and after ▪ Metadata and documentation ▪ Storage during the research ▪ Dissemination after the grant ▪ Sharing and public access policies ▪ Roles and responsibilities DMPTool (US) https://dmptool.org
23. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Reproducibility
24. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Discussion Questions Have you ever had issues reproducing your or someone else's research? What caused the issues?
25. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Reproducibility in Research Source: Baker, Monya. 2016. "1,500 scientists lift the lid on reproducibility." Nature News 533(7604): 452-454. https://dx.doi.org/10.1038/533452a
26. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Why Care About Reproducibility? PLOS journals require authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception…When submitting a manuscript online, authors must provide a Data Availability Statement describing compliance with PLOS’s policy. Source: PLOS. (2014, March 1). Data access for the open access literature: PLOS’s data policy. PLOS. http://www.plos.org/data-access-for-the-open-access-literature-ploss-data-policy
27. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program For reproducibility... http://phdcomics.com/comics.php?f=1689
28. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Connecting Research Source: Vicky Steeves. 2017. “Building Services Around Reproducibility & Open Scholarship.” https://osf.io/pv6ea
29. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Reviewable Research: Sufficient detail for peer review & assessment Replicable Research: Tools are available to duplicate the author’s results using their data Confirmable Research: Main conclusions can be obtained independently without author’s software Auditable Research: Process & tools archived such that it can be defended later if necessary Open/Reproducible Research: Auditable research made openly available Reproducibility on a Spectrum Stodden et al ICERM report (2013)
30. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Recipe for Reproducibility
31. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Recipe for Reproducibility 1. Quality Assurance ❏ Collecting, validating and organizing data 2. Documentation ❏ Contextual information on data discovery, access, use, and reuse 3. Code & Scripts ❏ Code and automated scripts associated with analyses 4. Dissemination ❏ Submission of data and related products to open repositories
32. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Record Keeping
33. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Enabling Reproducibility ➕ 〓 ➕ 〓
34. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program You can't have any sort of reproducibility without good data and project management.
35. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Stretch Break!
36. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Open Science Framework
37. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Discussion Questions Have you used or do you use a digital notebook? What platform(s) have you used?
38. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program ELN Comparison Matrix
39. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program
40. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Open Science Framework Managing a research workflow • Collaboration • File Storage • Version Control • Hub for Services • Project Management
41. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Data Storage
42. OSF Integrations
43. OSF
45. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Setting Up a Project
46. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Copy or Fork a Project
47. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Let’s try! Project Management Template https://osf.io/meyva
48. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program OSF Features for Research ▪ Contributors & Activity ▪ Wiki ▪ Components ▪ File storage & Addons ▪ Versioning ▪ Publishing & Licenses ▪ Citation & DOI ▪ Analytics
49. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Contributors: Research collaboration PERMISSIONS
50. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Activity Log: Project progress
51. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Wiki: Descriptive documentation
52. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Components: Robust organization
53. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Files: Facilitate sharing
54. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Addons: Link to GitHub files
55. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Versions: Track project across time
56. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Storage: File management
57. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Publishing Your Project • attach a DOI to a public OSF project • assign a license to a project • fine grained privacy controls allow flexibility in what you share Make a project public
58. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Visibility & License LICENSE MAKE A PROJECT PUBLIC TO GET A DOI
59. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Discoverability DOI GLOBALLY UNIQUE IDENTIFIER
60. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program In Action: Supplemental materials Results and analyses for experiments reported on in the article are available on the Open Science Framework at http:/ /osf.io/u6s79/ Melissa Kline, Jesse Snedeker & Laura Schulz (2017) “Linking Language and Events: Spatiotemporal Cues Drive Children’s Expectations About the Meanings of Novel Transitive Verbs.” Language Learning and Development 13(1): 1-23. http:/ /dx.doi.org/10.1080/15475441.2016.1171771
61. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program In Action: Project registration
62. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program In Action: Preprint publication
63. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Analytics FILE DOWNLOADS
64. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Project Lifecycle REGISTRY PREPRINT PROJECT DATA AND MATERIALS PEER-REVIEWED PUBLICATION
65. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Wrap up
66. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Next Steps ▪ Data Management covers the entire data lifecycle ▪ Can you (or someone else) find and use your data? ▪ Data management is for all projects ▪ Even if you're not sharing data publicly, you still don't want to lose it or lose track of your analyses ▪ Data Management is a complex, collaborative effort ▪ Data management is incremental ▪ Don’t get overwhelmed! Identify activities & implement gradually
67. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Research Data Management Training FREE CANVAS MOOC YOUTUBE VIDEOS
68. LIBRARY.HARVARD.EDU @HarvardLibrary Julie Goldman Research Data Management Program Thank you! Questions? Feel free to email me: julie_goldman@harvard.edu Resources: bit.ly/rdm-resources