Searching by grant number: comparison of funding acknowledgments in NIH RePORTER, PubMed, and Web of Science
Keywords:Funding Acknowledgment, Web of Science, Scopus, NIH Reporter, Grants, Bibliometrics
Objective: Several publication databases now index the associated funding agency and grant number metadata with their publication records. Librarians who are familiar with the particulars of these databases can assist investigators and administrators with data gathering for publication summaries and metrics required for renewals of and progress reports for National Institutes of Health (NIH) grants.
Methods: Publication lists were pulled from three main indexers of publication-associated funding information (NIH RePORTER, PubMed, and Web of Science), using iterative search strategies. All discovered variations for the cited grant number of interest were recorded and tested. Publication lists were compared for overall coverage.
Results: A total of 986 publications citing the single grant number of interest were returned from the given time frame: 920 were found in PubMed, 860 in NIH RePORTER, and 787 in Web of Science. Web of Science offered the highest percentage of publications that were not found in the other 2 sources (n=63). Analysis of publication funding acknowledgments uncovered 21 variations of the specific NIH award of interest that were used to report funding support.
Conclusions: This study shows that while PubMed returns the most robust list of publications, variations in the format of reported funding support and indexing practices meant no one resource was sufficient to capture all publications that cited a given NIH project grant number. Librarians looking to help build grant-specific publication lists will need to use multiple resources and be aware of the most frequently reported grant variations to identify a comprehensive list of supported publications.
This article has been approved for the Medical Library Association’s Independent Reading Program.
Alvarez-Bornstein B, Morillo F, Bordons M. Funding acknowledgments in the Web of Science: completeness and accuracy of collected data. Scientometrics. 2017 Sep;112(3):1793–812.
Begum M, Lewison G. Web of Science research funding information: methodology for its use in analysis and evaluation. J Scientometr Res. 2017 May–Aug;6(2):65–73.
Costas R, Yegros-Yegros A. Possibilities of funding acknowledgement analysis for the bibliometric study of research funding organizations: case study of the Austrian Science Fund (Fwf). Pro Int Conf Sci Inf. 2013:1401–8.
Grassano N, Rotolo D, Hutton J, Lang F, Hopkins MM. Funding data from publication acknowledgments: coverage, uses, and limitations. J Assoc Inf Sci Technol. 2017 Apr;68(4):999–1017.
Koier E, Horlings E. How accurately does output reflect the nature and design of transdisciplinary research programmes? Res Evaluat. 2015 Jan;24(1):37–50.
Kokol P, Vosner HB. Discrepancies among Scopus, Web of Science, and PubMed coverage of funding information in medical journal articles. J Med Libr Assoc. 2018 Jan;106(1):81–6. DOI: http://dx.doi.org/10.5195/jmla.2018.181.
Paul-Hus A, Desrochers N, Costas R. Characterization, description, and considerations for the use of funding acknowledgement data in Web of Science. Scientometrics. 2016 Jul;108(1):167–82.
Sirtes D. Funding acknowledgements for the German research foundation (Dfg): the dirty data of the Web of Science database and how to clean it up. Pro Int Conf Sci Inf. 2013:784–95.
Tang L, Hu GY, Liu WS. Funding acknowledgment analysis: queries and caveats. J Assoc Inf Sci Tech. 2017;68(3):790–4.
Moller T, Schmidt M, Hornbostel S. Assessing the effects of the German Excellence Initiative with bibliometric methods. Scientometrics. 2016 Dec;109(3):2217–39.
Winkelman S, Rots A. Usefulness and dangers of relying on grant acknowledgments in an observatory bibliography. Proc Spie. 2016;9910.
Costas R, van Leeuwen TN. Approaching the “reward triangle”: general analysis of the presence of funding acknowledgments and “peer interactive communication” in scientific publications. J Am Soc Inf Sci Tech. 2012 Aug;63(8):1647–61.
National Institutes of Health. RePORTER frequently asked questions (FAQs): about the information available in RePORTER [Internet]. The Institutes [updated 26 May 2012; cited 14 Jan 2019]. <https://report.nih.gov/faq.aspx?sid=2>.
US National Library of Medicine. Funding support (grant) information in MEDLINE/PubMed [Internet]. The Library [updated 8 Aug 2018; cited 14 Jan 2019]. <https://www.nlm.nih.gov/bsd/funding_support.html>.
Clarivate Analytics. Searching the grant number field [Internet]. Clarivate Analytics [updated 31 Jan 2018; cited 14 Jan 2019]. <https://images.webofknowledge.com/images/help/WOS/hs_grant_number.html>.
This work is licensed under a Creative Commons Attribution 4.0 International License.