Trends in Research Data Management

This presentation was given as part of the Augusta University RDM Symposium. Its goals were to:

Identify the impact and implications of research data management for current research and future research trends
Describe the importance of good data management
Define the major components of good data management
Identify and define the data of your research
Identify practical roles and implementations of data management

Transcript

1. Trends in Research Data Management Amy Nurnberger Program Head, Data Management Services @ANurnberger Augusta University RDM Symposium 2019-03-19 This work is licensed under a Creative Commons Attribution 4.0 International License.
2. Trends in Research Data Management (RDM) Why you should care How it will improve your life What you can do
3. Trends in Research Data Management (RDM) Identify the impact and implications of research data management for current research and future research trends Describe the importance of good data management Define the major components of good data management Identify and define the data of your research Identify practical roles and implementations of data management Why you should care How it will improve your life What you can do
4. Nullius in verba The President, Council and Fellows of the Royal Society of London for Improving Natural Knowledge (~1660)
5. Take nobody’s word for it
6. In God we trust, others must provide data. ~Anon. Attributed to Prof. of Path, Edwin R. Fisher (1978), W. Edwards Deming, others (from https://quoteinvestigator. com/2017/12/29/god-data/)
7. If I have seen further, it is by standing on the shoulders of Giants. ~ Isaac Newton
8. If I have seen further, it is by standing on the shoulders of Giants. ~ Isaac Newton
9. If I have seen further, it is by standing on the shoulders of Giants. ~ Isaac Newton
10. Take nobody’s word for it Standing on the shoulders of giants
11. https://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century
12. https://www.forbes.com/sites/louiscolumbus/2018/01/29/data-scientist-is-the-best-job-in-america- according-glassdoors-2018-rankings/#397f0fec5535 https://insidebigdata.com/2019/02/02/data-scientist-is-still-a-hot-job-and-pays-well- too/
13. https://www.economist.com/leaders/2010/02/25/the- data-deluge
15. https://www.amazon.com/Bacon-Shirt-Funny-Computer-Science/dp/B07D34C7CJ
17. Mittelmeer. Südfrankreich. by Spacebirdy/Myndir
18. Hydrogen balloon explosion [cropped] by Maxim Bilovitskiy https://commons.wikimedia.org/wiki/File:Hydrogen_balloon_explosion.jpg CC By SA 4.0
19. AZ Passive Rain Water Collection System by Alan Levine https://www.flickr.com/photos/cogdog/2802218586/ Public Domain
20. HydrAid (R) BioSand Water Filter by TripleQuest https://commons.wikimedia.org/wiki/File:HydrAid%C2%AE_BioSand_Wa ter_Filter.jpg CC By SA 3.0 Sewage treatment plant by eutrophication&hypoxia https://www.flickr.com/photos/48722974@N07/4515205247 CC By 2.0 WaterPurification by unknown https://pxhere.com/en/photo/976744 CC0
21. HydrAid (R) BioSand Water Filter by TripleQuest https://commons.wikimedia.org/wiki/File:HydrAid%C2%AE_BioSand_Wa ter_Filter.jpg CC By SA 3.0 WaterPurification by unknown https://pxhere.com/en/photo/976744 CC0 Well spudder 8606 by unknown https://commons.wikimedia.org/wiki/File:Well_spudder_8606.jpg CC By SA 3.0 & GFDL Chercher d'or dans la Cherokee Forest by Guillaume Capron https://www.flickr.com/photos/gcapron/6167785594/ CC By SA 2.0
22. Hydrogen balloon explosion [cropped] by Maxim Bilovitskiy https://commons.wikimedia.org/wiki/File:Hydrogen_balloon_explosion.jpg CC By SA 4.0 AZ Passive Rain Water Collection System by Alan Levine https://www.flickr.com/photos/cogdog/2802218586/ Public Domain HydrAid (R) BioSand Water Filter by TripleQuest https://commons.wikimedia.org/wiki/File:HydrAid%C2%AE_BioSand_Wa ter_Filter.jpg CC By SA 3.0 Sewage treatment plant by eutrophication&hypoxia https://www.flickr.com/photos/48722974@N07/4515205247 CC By 2.0 WaterPurification by unknown https://pxhere.com/en/photo/976744 CC0 Well spudder 8606 by unknown https://commons.wikimedia.org/wiki/File:Well_spudder_8606.jpg CC By SA 3.0 & GFDL Chercher d'or dans la Cherokee Forest by Guillaume Capron https://www.flickr.com/photos/gcapron/6167785594/ CC By SA 2.0 Mt Tabor Park by MB298 https://commons.wikimedia.org/wiki/File:Mt_Tabor_02.jpg CC By SA 4.0
23. Recycle by Daniel Llamas Soto, ES © https://thenounproject.com/term/recycle/2300995
25. Berendsen, TA; Bruinsma, BG; Puts, CF; Saeidi, N; Usta, OB; Uygun, BE; Izamis, Maria-Louisa; Toner, Mehmet; Yarmush, Martin L; Uygun, Korkut (2014). "Supercooling enables long-term transplantation survival following 4 days of liver preservation". Nature Medicine. 20 (7): 790–793. doi:10.1038/nm.3588. PMC 4141719. PMID 24973919. https://www.nature.com/articles/nm.3588 https://en-exact-sciences.tau.ac.il/news_beck Jacoby, G., Cohen, K., Barkan, K., Talmon, Y., Peer, D., & Beck, R. (2015). Metastability in lipid based particles exhibits temporally deterministic and controllable behavior. Scientific Reports, 5, 9481. Retrieved from https://doi.org/10.1038/srep09481
26. Computational methods Machine learning Neural nets
27. Computational methods Machine learning Neural nets Decision support systems Intelligence augmentation
28. Divining Rod by Thomas Pennant from the National Library of Wales [cropped] https://commons.wikimedia.org/wiki/File:Divining_Rod.jpg Public Domain
29. “machine learning has become alchemy…If you’re building photo sharing services, alchemy is fine. But we’re now building systems that govern health care and our participation in civil debate. I would like to live in a world whose systems are built on rigorous, reliable, verifiable knowledge, and not on alchemy.” Ali Rahimi and Ben Recht , 2017-12-05 on accepting NIPS 2017 ‘Test of Time’ award, http://www.argmin.net/2017/12/05/kitchen-sinks/ Divining Rod by Thomas Pennant from the National Library of Wales [cropped] https://commons.wikimedia.org/wiki/File:Divining_Rod.jpg Public Domain
30. Take nobody’s word for it Standing on the shoulders of giants
31. Good management
32. Good management Poor management
33. Good Data Management If the data you need still exists; If you found the data you need; If you understand the data you found; If you trust the data you understand; If you can use the data you trust; Someone did a good job of data management. - Rex Sanders, USGS
34. Park drinking faucet by orange31 https://pixabay.com/photos/park-drinking-faucet-3993490/ Pixabay license https://pixabay.com/service/license/
35. Park drinking faucet by orange31 https://pixabay.com/photos/park-drinking-faucet-3993490/ Pixabay license https://pixabay.com/service/license/ #drinkableData
36. #drinkableData
37. Information entropy Information Content of Data and Metadata Time of data development Specific details about problems with individual items or specific dates are lost relatively rapidly General details about datasets are lost through time Accident or technology change may make data unusable Retirement or career change makes access to “mental storage” difficult or unlikely Loss of investigator leads to loss of remaining information TIME From Michener et al 1997 http://dx.doi.org/10.1890/1051-0761(1997)007[0330:NMFTES]2.0.CO;2) Vines, T. H., Albert, A. Y. K., Andrew, R. L., Débarre, F., Bock, D. G., Franklin, M. T., … Rennison, D. J. (2014). The Availability of Research Data Declines Rapidly with Article Age. Current Biology, 24(1), 94–97. https://doi.org/10.1016/j.cub.2013.11.014
38. Figure 1. Distribution of 2004–2005 citation counts of 85 trials by data availability. Piwowar HA, Day RS, Fridsma DB (2007) Sharing Detailed Research Data Is Associated with Increased Citation Rate. PLoS ONE 2(3): e308. https://doi.org/10.1371/journal.pone.0000308 Increase impact and efficiency “Very significant increases in research, teaching and studying efficiency were realised by the users as a result of their use of the data centres;” Beagrie, N. and Houghton J.W. (2014) The Value and Impact of Data Sharing and Curation: A synthesis of three recent studies of UK research data centres, Jisc. http://repository.jisc.ac.uk/5568/1/iDF308_- _Digital_Infrastructure_Directions_Report%2C_Jan14_v1-04.pdf for economic & social, archaeology, and atmospheric data
39. Good Data Management If the data you need still exists; If you found the data you need; If you understand the data you found; If you trust the data you understand; If you can use the data you trust; Someone did a good job of data management. - Rex Sanders, USGS
40. The Data of Research Material or information "on which an argument, theory, test or hypothesis, or another research output is based." “(i) Research data is defined as the recorded factual material commonly accepted in the [research] community as necessary to validate research findings…” Queensland University of Technology. Manual of Procedures and Policies. Section 2.8.3. http://www.mopp.qut.edu.au/D/D_02_08.jsp http://www.whitehouse.gov/omb/circulars_a110#36
42. Tools Supporting information Metadata
43. Tools Supporting information Metadata - Instrument settings - Patient information - Conditions at time of collection - readMe files - What, Why, When, Where, How - Analysis scripts and algorithms - Software & versions - R code, Jupyter notebooks - Models, neural nets, etc. - Code books - Survey instruments - Data dictionaries
44. Adapted from Jeffrey Heer
45. Adapted from Jeffrey Heer Acquisition & Processing Planning & Preparation Analysis & Interpretation Publicizing Distribution & Discovery
46. Planning and Preparation
47. Planning and Preparation - Identifying disciplinary expectations for data - Identifying funder expectations for data - Drafting data management plan - Structuring data management procedures/practices for research project - Negotiating data use agreements - Identifying resources
48. Acquisition and Processing - Backups - Finding/creating data - Giving credit for data - File naming - Versioning - Describing - Cleaning - Making tidy data - Backups!!!! - Storage - Tools - Formats: - Conversion - Interoperability - Quality - Security
49. Analysis and Interpretation - Documenting processes - Analysis - Visualizations - Versioning - Tools - Visual / data / statistical literacy - Tidy data
50. Publicizing, Distribution & Discovery - Formats - Descriptions - Repositories - Intellectual property - Reuse & data use agreements - Data citations - Identifiers: - DOIs - ORCiDs
51. Acquisition & Processing Planning & Preparation Analysis & Interpretation Publicizing Distribution & Discovery Goben, Abigail, and Megan R. Sapp Nelson. 2018. "The Data Engagement Opportunities Scaffold: Development and Implementation." Journal of eScience Librarianship 7(2): e1128. https://doi.org/10.7191/jeslib.2018.1128 ENGAGEMENT
52. Sensitive, Restricted and Secure data - Restriction = responsible sharing - Rational risk assessment - Who has access to do what, when? Who should? - Security through obscurity ← not a thing
53. Ethics of data – Data bias – Algorithmically reinforced bias • Machine learning • Deep learning • Assisted decision support systems o Transparent vs Black box algorithms – Data ownership • Privacy • AI rights thepublicvoice.org/ai- universal-guidelines
54. #drinkableData
55. #drinkableData
56. #drinkableData
57. #drinkableData
58. #drinkableData
59. #drinkableData Learning § NIH Big Data to Knowledge Training Coordination Center: https://bigdatau.ini.usc.edu/data- science-seminars § Mantra Research Data Management Training: https://mantra.edina.ac.uk/ Teaching § Project TIER, Teaching Integrity in Empirical Research: https://www.projecttier.org/
60. #drinkableData Learning § NIH Big Data to Knowledge Training Coordination Center: https://bigdatau.ini.usc.edu/data- science-seminars § Mantra Research Data Management Training: https://mantra.edina.ac.uk/ Teaching § Project TIER, Teaching Integrity in Empirical Research: https://www.projecttier.org/
61. Thank you! Let’s talk… Amy Nurnberger [she/her(s)], ORCID: 0000-0002-5931- 072X Program Head, Data Management Services - Massachusetts Institute of Technology Adjunct Assistant Professor, Learning Analytics, Teachers College, Columbia University Research Data Alliance (RDA) - Organisational Advisory Board, co-chair - Education and Training on Handling Research Data WG, co-chair Twitter: @ANurnberger This work is licensed under a Creative Commons Attribution 4.0 International License.
62. References that did not appear on slides Royal Society coat-of-arms.User Kaihsu on en.wikipedia [CC BY-SA 3.0 (http://creativecommons.org/licenses/by-sa/3.0/)]. https://commons.wikimedia.org/wiki/File:RoyalSocCOA20040420.jpg Logo of “Royal Society” https://en.wikipedia.org/wiki/File:The_Royal_Society_Coat_of_Arms.svg © Used under fair use. Stained glass window, Royal Society. The wub [CC BY-SA 4.0 (https://creativecommons.org/licenses/by-sa/4.0)] https://commons.wikimedia.org/wiki/File:Stained_glass_window,_Royal_Society.jpg Chartres by dvdbramhall (cropped) https://www.flickr.com/photos/bramhall/36540453455/ CC BY NC ND 2.0 https://creativecommons.org/licenses/by-nc-nd/2.0/ Library of Congress, Rosenwald 4, Bl. 5r (cropped) https://en.wikipedia.org/wiki/File:Library_of_Congress,_Rosenwald_4,_Bl._5r.jpg Public Domain. Big Data. TheDigitalArtist on Pixabay. https://pixabay.com/illustrations/big-data- information-data-3964871/ Pixabay License. https://pixabay.com/service/license/ Itaipu, Decembre 2007 - Vue Générale by Martin St-Amant https://en.wikipedia.org/wiki/File:Itaipu_D%C3%A9cembre_2007_- _Vue_G%C3%A9n%C3%A9rale.jpg CC By SA 3.0 Azpeitia steam train by Nils Öberg https://commons.wikimedia.org/wiki/File:Azpeitia_steam_train_on_the_line_to_Lasao.J PG CC By SA 3.0 Hotel de Glace by Matias Garabedian https://commons.wikimedia.org/wiki/File:H%C3%B4tel_de_Glace_(12665425493).jpg CC By SA 2.0 KiezersgradchtReguliersgrachtAmsterdam (corrected) by Massimo Catarinella and Lycaon https://commons.wikimedia.org/wiki/File:KeizersgrachtReguliersgrachtAmsterdam_(cor rected).jpg CC By SA 2.0 Station being pumped out by Metropolitan Transit Authority https://www.flickr.com/photos/mtaphotos/8152151223/in/photostream/ CC By 2.0 Park drinking faucet by orange31 https://pixabay.com/photos/park-drinking-faucet- 3993490/ Pixabay license https://pixabay.com/service/license/ Urban water cycle by EPA https://commons.wikimedia.org/wiki/File:Urban_Water_Cycle_-_EPA_2004.png Public Domain Please respect the rights and licenses of the authors and creators All icons licensed from Noun Project and are copyright protected