Cargando…

Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level

Despite their recognized limitations, bibliometric assessments of scientific productivity have been widely adopted. We describe here an improved method to quantify the influence of a research article by making novel use of its co-citation network to field-normalize the number of citations it has rec...

Descripción completa

Detalles Bibliográficos
Autores principales: Hutchins, B. Ian, Yuan, Xin, Anderson, James M., Santangelo, George M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5012559/
https://www.ncbi.nlm.nih.gov/pubmed/27599104
http://dx.doi.org/10.1371/journal.pbio.1002541
_version_ 1782452007709179904
author Hutchins, B. Ian
Yuan, Xin
Anderson, James M.
Santangelo, George M.
author_facet Hutchins, B. Ian
Yuan, Xin
Anderson, James M.
Santangelo, George M.
author_sort Hutchins, B. Ian
collection PubMed
description Despite their recognized limitations, bibliometric assessments of scientific productivity have been widely adopted. We describe here an improved method to quantify the influence of a research article by making novel use of its co-citation network to field-normalize the number of citations it has received. Article citation rates are divided by an expected citation rate that is derived from performance of articles in the same field and benchmarked to a peer comparison group. The resulting Relative Citation Ratio is article level and field independent and provides an alternative to the invalid practice of using journal impact factors to identify influential papers. To illustrate one application of our method, we analyzed 88,835 articles published between 2003 and 2010 and found that the National Institutes of Health awardees who authored those papers occupy relatively stable positions of influence across all disciplines. We demonstrate that the values generated by this method strongly correlate with the opinions of subject matter experts in biomedical research and suggest that the same approach should be generally applicable to articles published in all areas of science. A beta version of iCite, our web tool for calculating Relative Citation Ratios of articles listed in PubMed, is available at https://icite.od.nih.gov.
format Online
Article
Text
id pubmed-5012559
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-50125592016-09-27 Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level Hutchins, B. Ian Yuan, Xin Anderson, James M. Santangelo, George M. PLoS Biol Meta-Research Article Despite their recognized limitations, bibliometric assessments of scientific productivity have been widely adopted. We describe here an improved method to quantify the influence of a research article by making novel use of its co-citation network to field-normalize the number of citations it has received. Article citation rates are divided by an expected citation rate that is derived from performance of articles in the same field and benchmarked to a peer comparison group. The resulting Relative Citation Ratio is article level and field independent and provides an alternative to the invalid practice of using journal impact factors to identify influential papers. To illustrate one application of our method, we analyzed 88,835 articles published between 2003 and 2010 and found that the National Institutes of Health awardees who authored those papers occupy relatively stable positions of influence across all disciplines. We demonstrate that the values generated by this method strongly correlate with the opinions of subject matter experts in biomedical research and suggest that the same approach should be generally applicable to articles published in all areas of science. A beta version of iCite, our web tool for calculating Relative Citation Ratios of articles listed in PubMed, is available at https://icite.od.nih.gov. Public Library of Science 2016-09-06 /pmc/articles/PMC5012559/ /pubmed/27599104 http://dx.doi.org/10.1371/journal.pbio.1002541 Text en https://creativecommons.org/publicdomain/zero/1.0/ This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 (https://creativecommons.org/publicdomain/zero/1.0/) public domain dedication.
spellingShingle Meta-Research Article
Hutchins, B. Ian
Yuan, Xin
Anderson, James M.
Santangelo, George M.
Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
title Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
title_full Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
title_fullStr Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
title_full_unstemmed Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
title_short Relative Citation Ratio (RCR): A New Metric That Uses Citation Rates to Measure Influence at the Article Level
title_sort relative citation ratio (rcr): a new metric that uses citation rates to measure influence at the article level
topic Meta-Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5012559/
https://www.ncbi.nlm.nih.gov/pubmed/27599104
http://dx.doi.org/10.1371/journal.pbio.1002541
work_keys_str_mv AT hutchinsbian relativecitationratiorcranewmetricthatusescitationratestomeasureinfluenceatthearticlelevel
AT yuanxin relativecitationratiorcranewmetricthatusescitationratestomeasureinfluenceatthearticlelevel
AT andersonjamesm relativecitationratiorcranewmetricthatusescitationratestomeasureinfluenceatthearticlelevel
AT santangelogeorgem relativecitationratiorcranewmetricthatusescitationratestomeasureinfluenceatthearticlelevel