research? • Does an institution have an effective research program? • Is the research being effectively disseminated? • Is the work advancing the field?
answers – Find out what researchers really need & try to meet that need. • Some unanswered questions – What do the different metrics tell you? – Whose needs are best served by which info? • Some unasked questions
oncology publications could not be reproduced. • Bayer: 43 of 67 oncology & cardiovascular projects were based on contradictory results • Dr. John Ioannidis: Of 432 publications purporting sex differences in hypertension, multiple sclerosis, or lung cancer, only one data set was reproducible.
twice as frequently as articles with no data… but otherwise equal qualifications” Gleditsch, N.P. & Strand, H. Posting your data: will you be scooped or will you be famous? International Studies Perspectives 4, 89-97 (2003). http://dx.doi.org/10.1111/1528-3577.04105
that we use… I would like for you to think of yourselves as people engaged in a task that is important to everyone and not just people in a scholarly niche.”
meet researcher needs. • Let’s get the context right for metrics. • Practical tips – Collect lots of data – Build expertise in analysis – Make that data available openly – it’s more valuable in aggregate than siloed apart.