The relative citation ratio: what is it and why should medical librarians care?

Authors

DOI:

https://doi.org/10.5195/jmla.2018.499

Keywords:

Bibliometrics, Relative Citation Ratio, Research Impact

Abstract

Bibliometrics is becoming increasingly prominent in the world of medical libraries. The number of presentations related to research impact at the Medical Library Association (MLA) annual meeting has been increasing in past years. Medical centers have been using institutional dashboards to track clinical performance for over a decade, and more recently, these institutional dashboards have included measures of academic performance. This commentary reviews current practices and considers the role for a newer metric, the relative citation ratio.

Author Biographies

Alisa Surkis, Assistant Director for Research Data and Metrics, Health Sciences Library, NYU, 577 1st Avenue, New York, NY 10016

Assistant Director for Research Data and Metrics

NYU Health Sciences Library

Stuart Spore, Lead, Scholarly Output Assessment, Health Sciences Library, NYU, 577 1st Avenue, New York, NY 10016

Lead, Scholarly Output Assessment/Senior Systems Advisor

NYU Health Sciences Library

References

Buttigieg SC, Pace A, Rathert C. Hospital performance dashboards: a literature review. J Health Organ Manag. 2017 May 15;31(3):385–406.

Tachibana C. New tools for measuring academic performance. Science. 2017 Feb 10 2017;355(6325):651–4.

Deciphering impact factors. Nature Neurosci. 2003;6:783. DOI: http://dx.doi.org/10.1038/nn0803-783.

Santangelo GM. Article-level assessment of influence and translation in biomedical research. Mol Biol Cell. 2017 Jun 1;28(11):1401–8.

Hirsch JE. An index to quantify an individual’s scientific research output. Proc Natl Acad Sci U S A. 2005 Nov 15;102(46):16569–72.

Harzing AW, Alakangas S. Google Scholar, Scopus and the Web of Science: a longitudinal and cross-disciplinary comparison. Scientometrics. 2016 Feb 1;106(2):787–804. http://dx.doi.org/10.1007/s11192-015-1798-9.

Ball P. The h-index, or the academic equivalent of the stag’s antlers. Guardian. 2012 6 Jan 2012.

Hutchins BI, Yuan X, Anderson JM, Santangelo GM. Relative citation ratio (RCR): a new metric that uses citation rates to measure influence at the article level [Internet]. bioRxiv. 2015 [cited 23 Jul 2018]. <https://www.biorxiv.org/content/biorxiv/early/2015/10/22/029629.full.pdf>.

Hutchins BI, Yuan X, Anderson JM, Santangelo GM. Relative citation ratio (RCR): a new metric that uses citation rates to measure influence at the article level. PLoS Biol. 2016 Sep 6;14(9):e1002541.

Crespo JA, Herranz N, Li Y, Ruiz-Castillo J. The effect on citation inequality of differences in citation practices at the web of science subject category level. J Assoc Inf Sci Technol. 2014 Jun;65(6):1244–56. DOI: http://dx.doi.org/10.1002/asi.23006.

Abramo G, Cicero T, D’Angelo CA. Revisiting the scaling of citations for research assessment. J Informetr. 2012 Oct;6(4):470–-9. DOI: http://dx.doi.org/10.1016/j.joi.2012.03.005.

Radicchi F, Fortunato S, Castellano C. Universality of citation distributions: toward an objective measure of scientific impact. Proc Natl Acad Sci U S A. 2008 Nov 11;105(45):17268–72. DOI: http://dx.doi.org/10.1073/pnas.0806977105.

Li Y, Radicchi F, Castellano C, Ruiz-Castillo J. Quantitative evaluation of alternative field normalization procedures. J Informetr. 2013 Jul;7(3):746–55. DOI: http://dx.doi.org/10.1016/j.joi.2013.06.001.

National Institute of Health, Office of Portfolio Analysis. iCite new analysis [Internet]. The Institutes [cited 23 Jul 2018]. <https://icite.od.nih.gov/analysis>.

National Institute of Health, Office of Portfolio Analysis. iCite API [Internet]. The Institutes [cited 23 Jul 2018]. <https://icite.od.nih.gov/api>.

Vieira D, McGowan R, McCrillis A, Lamb I, Larson C, Bakker T, Spore S. The Faculty Bibliography Project at the NYU School of Medicine. J Librariansh Schol Commun. 2014;2(3):eP1161.

Bornmann L, Haunschild R. Relative citation ratio (RCR): an empirical attempt to study a new field - normalized bibliometric indicator. J Assoc Inf Sci Technol. 2017;68(4):1064–7. DOI: http://dx.doi.org/10.1002/asi.23729.

Janssens ACJW, Goodman M, Powell KR, Gwinn M. A critical evaluation of the algorithm behind the relative citation ratio (RCR). PLoS Biol. 2017 Oct 2;15(10):e2002536. http://dx.doi.org/10.1371/journal.pbio.2002536.

Waltman L. NIH’s new citation metric: a step forward in quantifying scientific impact? Centre for Science and Technology Studies Blog [Internet]. 2 Nov 2015 [cited 23 Jul 2018]. <https://www.cwts.nl/blog?article=n-q2u294>.

Ioannidis JPA, Boyack K, Wouters PF. Citation metrics: a primer on how (not) to normalize. PLoS Biol. 2016 Sep 6;14(9):e1002542. DOI: http://dx.doi.org/10.1371/journal.pbio.1002542.

Basken P. Better than impact factor? NIH team claims key advance in ranking journal articles. Chron Higher Educ. 2016 Sep 7.

Schneider M, Kane CM, Rainwater J, Guerrero L, Tong G, Desai SR, Trochim W. Feasibility of common bibliometrics in evaluating translational science. J Clin Transl Sci. 2017 Feb;1(1):45–52. DOI: http://dx.doi.org/10.1017/cts.2016.8.

Gao Y, Stanley DV, Robinson VC, Reid DM, Galis ZS. Angiogenesis research: extramural portfolio supported by the National Heart, Lung, and Blood Institute, 2008–2015. Circ Res. 2017 May 26;120(11):1713–7. DOI: http://dx.doi.org/10.1161/CIRCRESAHA.117.310735.

Bornmann L, Williams R. Can the journal impact factor be used as a criterion for the selection of junior researchers? a large-scale empirical study based on ResearcherID data. J Informetr. 2017 Aug;11(3):788–99. DOI: http://dx.doi.org/10.1016/j.joi.2017.06.001.

Rock CB, Prabhu AV, Fuller CD, Thomas CR, Holliday EB. Evaluation of the relative citation ratio, a new National Institutes of Health–supported bibliometric measure of research productivity, among academic radiation oncologists. J Am Coll Radiol. 2018 Mar;15(3, pt A):469–74. DOI: http://dx.doi.org/10.1016/j.jacr.2017.11.006.

Yu F, Hayes B. Applying data analytics and visualization to assessing the research impact of the Cancer Cell Biology (CCB) Program at the University of North Carolina at Chapel Hill. J eSci Librariansh. 2018 7(1):e1123.

Ündar A. The relative citation ratio: measuring impact of publications from an international conference with a new NIH metric. Artifi Organs. 2017 Dec;41(12):1085–91. http://dx.doi.org/10.1111/aor.13079.

Hutchins BI, Hoppe TA, Meseroll RA, Anderson JM, Santangelo GM. Additional support for RCR: a validated article-level measure of scientific influence. PLoS Biol. 2017 Oct 2;15(10):e2003552. http://dx.doi.org/10.1371/journal.pbio.2003552.

Downloads

Published

2018-10-04

Issue

Section

Commentary