Article-Level Metrics

My presentation at the OASPA12 Conference in Budapest.

Transcript

1. 1 50,000 articles and counting We mark another milestone in our mission to transform research communication. Article-Level Metrics Martin Fenner
2. 2 2854 34113 3247 2558 Scopus Citations ≥ 10 HTML Views ≥ 2000 PLOS ONE: the idea of the journal as a filter is falling apart Metrics collected August 8, 2012 42,772 PLOS ONE Papers
3. 3 0 50 100 150 0.005 0.010 0.015 0.020 0.025 0.030 Citations Probability Source: PLoS, Scopus. Metrics were collected on July 13, 2012. Journal-based aggregate metrics correlate poorly with individual articles Scopus citation counts (median: 18) Mendeley bookmarks (median 27) PLOS Biology research articles published in 2009 Probability
4. 4 108,872,370 HTML pageviews 24,670,713 PDF downloads 331,946 CrossRef citations What users do with PLOS papers Article-Level Metrics for 57,527 PLoS papers published until August 8, 2012. HTML pageviews and PDF downloads from PLoS journals website. 0.3% 100% 22.7% Citations are only a small fraction of how a paper is reused Article-Level Metrics collected August 8, 2012 for 57,527 PLOS Papers
5. 5 The PLOS Article-Level Metrics project started in 2009 and tracks usage, citations and social web activity for all PLOS articles. Usage Citations Social Web PLOS Journal Site (HTML, PDF, XML) CrossRef Mendeley PLOS Journal Site (HTML, PDF, XML) Scopus CiteULike PubMed Central (abstract, fulltext, PDF, figures) Web of Science Facebook PubMed Central (abstract, fulltext, PDF, figures) PubMed Central Twitter Wikipedia Research Blogging PLOS Comments
6. 6 PLoS HTML Views PMC HTML Views CrossRef Scopus PubMed Citations Mendeley CiteULike PLoS Comments Research Blogging Facebook Twitter PLoS HTML Views 98% 96% 62% 60% 48% 74% 26% 12% 2% 30% 7% Proportion of articles covered by source Metrics for 57,527 PLoS journal articles published until August 8, 2012.
7. 7 0 2 4 6 8 10 12 14 0 5000 10000 15000 20000 25000 30000 PLOS Medicine Articles August 2011 to August 2012 Combined HTML views and PDF downloads (PLOS website) for articles published between 08/16/11 and 08/15/12. Bubble size correlates with Scopus citations, bubble color with article type. Data collected 08/24/12. Months Total Views http://bit.ly/alm36
8. 7 0 2 4 6 8 10 12 14 0 5000 10000 15000 20000 25000 30000 PLOS Medicine Articles August 2011 to August 2012 Combined HTML views and PDF downloads (PLOS website) for articles published between 08/16/11 and 08/15/12. Bubble size correlates with Scopus citations, bubble color with article type. Data collected 08/24/12. Months Total Views http://bit.ly/alm36
9. 8 0 50 100 150 200 250 0 2000 4000 6000 8000 10000 12000 14000 PLOS Articles from the Big Food collection Tweets vs. HTML views at PLOS for articles in the Big Food collection. Circle size correlates with Facebook activity. Data collected August 19, 2012. Tweets HTML Views
10. 9 S S M T W T F 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2 3 S S M T W T F 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 9 1 2 S S M T W T F 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 S S M T W T F 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 5 6 7 8 9 10 11 1 2 3 4 31 April S S M T W T F 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 2 3 4 5 6 7 8 1 28 29 30 May S S M T W T F 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 1 2 3 4 5 6 26 27 28 29 30 31 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 6 26 11 7 26 172 19 19 12 119 43 53 June S S M T W T F 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 4 5 6 7 8 9 10 1 2 3 30 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 16 2 2 23 3 2 3 4 1 7 5 5 8 4 2 7 17 9 105 28 20 July S S M T W T F 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 2 3 4 5 6 7 28 29 30 31 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 1 1 3 2 1 5 4 1 12 5 August S S M T W T F 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 1 2 3 4 5 25 26 27 28 29 30 31 September October November December 50 100 150 Tweets about Big Food Collection Data collected August 19, 2012.
11. 10 0 5000 10000 15000 20000 0 500 1000 1500 2000 PLOS Medicine Research Articles Aug 2011 to Aug 2012 HTML views PLOS website vs. PubMed Central for reserch articles published between 08/16/11 and 08/15/12. Bubble size correlates with Facebook Likes/Shares/Comments. Data collected 08/24/12. PLOS HTML Views PubMed Central HTML Views
12. 11 100 200 500 1000 2000 5000 50 100 200 500 1000 2000 HTML views correlate with PDF downloads Usage data from PubMed Central for all 384 PLoS articles in the subject category Cancer Genetics. Log−log scale. Colors represent journals (PLoS ONE blue, PLoS Genetics green). HTML Views PDF Downloads
13. PLOS ALM Usage Patterns 12 "Scholarly User" "Broader Impact" PDF Downloads HTML Views PubMed Central PLOS Website Citations Facebook, Twitter
14. 13 Gaming and Spam
15. 14 PLOS Search API 2562 Articles CORDIS 1166 Articles Identify Open Access articles published by PLOS, funded by the European Commission Seventh Framework Programme (FP7) Match articles with grant numbers Show the impact of these publications
16. 15 0 10 20 30 40 0 5000 10000 15000 PLOS Publications from the EU−funded ENGAGE Project Total views are combined HTML views and PDF downloads from the PLOS website. Bubble size correlates with Scopus citations, and bubble color with the PLOS journal. Data collected September 19, 2012. Months Total Views European Network for Genetic and Genomic Epidemiology http://www.openaire.eu/en/component/openaire/project_info/default/530?grant=201413 Scopus
17. 16 0 10 20 30 40 0 5000 10000 15000 PLOS Publications from the EU−funded ENGAGE Project Total views are combined HTML views and PDF downloads from the PLOS website. Bubble size correlates with Mendeley bookmarks, and bubble color with the PLOS journal. Data collected September 19, 2012. Months Total Views Mendeley
18. Author locations from the ENGAGE project 17 First authors (blue) and last authors (green).
19. 18 0 20 40 60 80 0 10000 20000 30000 40000 50000 60000 PLOS Articles by Type: Review Total views are combined HTML views and PDF downloads from the PLOS website. Bubble size correlates with the number of CrossRef citations, and bubble color with the PLOS journal. Data collected August 23, 2012. Months Total Views
20. 18 0 20 40 60 80 0 10000 20000 30000 40000 50000 60000 PLOS Articles by Type: Review Total views are combined HTML views and PDF downloads from the PLOS website. Bubble size correlates with the number of CrossRef citations, and bubble color with the PLOS journal. Data collected August 23, 2012. Months Total Views
21. 19 http://blogs.bbsrc.ac.uk/index.php/2012/09/summertime-reprise/ http://dx.doi.org/10.1371/journal.pcbi.1000204
22. 20 Counter PubMed Central CrossRef PubMed Scopus Mendeley CiteULike Facebook Twitter Why PLoS Became a Publisher Noise Minimization in Eukaryotic Gene Expression Ras and Gpa2 Mediate One Branch of a Redundant Glucose Signaling Pathway in Yeast PLoS MedicineÂ˙ A Medical Journal for the Internet Age PLoS Computational Biology: A New Community Journal Using Microarrays to Facilitate Positional Cloning: Identification of Tomosyn as an Inhibitor of Neurosecretio Protein Molecular Function Prediction by Bayesian Phylogenomics Widespread Discordance of Gene Trees with Species Tree in Drosophila: Evidence for Incomplete Lineage Sorting Common Human Cancer Genes Discovered by Integrated Gene−Expression Analysis Putative Zinc Finger Protein Binding Sites Are Over−Represented in the Boundaries of Methylation−Resistant CpG Determining Physical Constraints in Transcriptional Initiation Complexes Using DNA Sequence Analysis Functional Annotation and Identification of Candidate Disease Genes by Computational Analysis of Normal Tissue Sepsid even−skipped Enhancers Are Functionally Conserved in Drosophila Despite Lack of Sequence Conservation Unraveling Protein Networks with Power Graph Analysis Pathogenesis of Listeria−Infected Drosophila wntD Mutants Is Associated with Elevated Levels of the Novel Immu Discerning the Complexity of Community Interactions Using a Drosophila Model of Polymicrobial Infections Silent but Not Static: Accelerated Base−Pair Substitution in Silenced Chromatin of Budding Yeasts A Careful Look at Binding Site Reorganization in the even−skipped Enhancers of Drosophila and Sepsids Ecological Niche of the 2003 West Nile Virus Epidemic in the Northern Great Plains of the United States Differential Gene Repertoire in Mycobacterium ulcerans Identifies Candidate Genes for Patho−Adaptation Identification and Gene Expression Analysis of a Taxonomically Restricted Cysteine−Rich Protein Family in Reef Detection of Cancer with Serum miRNAs on an Oligonucleotide Microarray A Core MYC Gene Expression Signature Is Prominent in Basal−Like Breast Cancer but Only Partially Overlaps the Impact of Chromatin Structures on DNA Processing for Genomic Analyses Identifying Cis−Regulatory Sequences by Word Profile Similarity Rising from the Ashes: DNA Repair in Deinococcus radiodurans Evolutionary Mirages: Selection on Binding Site Composition Creates the Illusion of Conserved Grammars in Dros Temporal and Spatial Requirements of unplugged/MuSK Function during Zebrafish Neuromuscular Development Dissecting Interferon−Induced Transcriptional Programs in Human Peripheral Blood Cells Patrimony and the Evolution of Risk−Taking The Fitness Landscapes of cis−Acting Binding Sites in Different Promoter and Environmental Contexts Exploring the Genetic Basis of Variation in Gene Predictions with a Synthetic Association Study Quantitative Analysis of the Drosophila Segmentation Regulatory Network Using Pattern Generating Potentials Chromatin Landscape Dictates HSF Binding to Target DNA Elements Detecting Cancer Gene Networks Characterized by Recurrent Genomic Alterations in a Population Multi−Disease Data Management System Platform for Vector−Borne Diseases Regulation of Zebrafish Hatching by Tetraspanin cd63 Meiotic Recombination Intermediates Are Resolved with Minimal Crossover Formation during Return−to−Growth, an An Information Theoretic, Microfluidic−Based Single Cell Analysis Permits Identification of Subpopulations amo Large−Scale Assessment of the Zebrafish Embryo as a Possible Predictive Model in Toxicity Testing Transmission Shifts Underlie Variability in Population Responses to Yersinia pestis Infection A Strategy for Full Interrogation of Prognostic Gene Expression Patterns: Exploring the Biology of Diffuse Lar Treponema denticola Major Outer Sheath Protein Induces Actin Assembly at Free Barbed Ends by a PIP2−Dependent Formation of Regulatory Modules by Local Sequence Duplication Zelda Binding in the Early Drosophila melanogaster Embryo Marks Regions Subsequently Activated at the Maternal PLOS Papers by Michael Eisen
24. ALM Business Models 22 non-profit publisher usage stats paid by publisher for profit service provider coverage of all journals coverage of books, datasets, etc. value-added services non-profit service provider coverage of all journals coverage of books, datasets, etc. value-added services for profit service provider coverage of all journals coverage of books, datasets, etc. value-added services
25. Open Article-Level Metrics 23 Open data, no license or other restrictions Transparent collection and calculation, e.g. using Open Source software Thinking beyond citations can help to show the Open Access advantage
26. Role of the (Open Access) Publisher 24 Provide usage data Pay for Article-Level Metrics Consider a non-profit organization to coordinate activities, help define best practices, etc.
27. Getting Started as a Publisher 25 Work with a service provider or Install or develop Article-Level Metrics software Take into account cost, technical expertise, but also who owns the data