Analyzing the citation impact of predatory journals in the health sciences
DOI:
https://doi.org/10.5195/jmla.2025.2024Keywords:
predatory journals, citation analysis, health sciences, Web of ScienceAbstract
Objective: Predatory journal articles do not undergo rigorous peer review and so their quality is potentially lower. Citing them disseminates the unreliable data they may contain and may undermine the integrity of science. Using citation analysis techniques, this study investigates the influence of predatory journals in the health sciences.
Methods: The twenty-six journals in the “Medical Sciences” category of a known predatory publisher were selected. The number of articles published by these journals was recorded based on the information from their websites. The “Cited References” search function in Web of Science was used to retrieve citation data for these journals.
Results: Of the 3,671 articles published in these predatory journals, 1,151 (31.4%) were cited at least once by 3,613 articles indexed in Web of Science. The number of articles that cited articles published in predatory journals increased significantly from 64 in 2014 to 665 in 2022, an increase of 10-fold in nine years. The citing articles were published by researchers from all over the world (from high-, middle-, and lower-income countries) and in the journals of traditional and open access publishers. Forty-three percent (1,560/3,613) of the citing articles were supported by research funds.
Conclusions: The content from articles published in predatory journals has infiltrated reputable health sciences journals to a substantial extent. It is crucial to develop strategies to prevent citing such articles.
References
Grudniewicz A, Moher D, Cobey KD, Bryson GL, Cukier S, Allen K, Ardern C, Balcom L, Barros T, Berger M, Ciro JB, Cugusi L, Donaldson MR, Egger M, Graham ID, Hodgkinson M, Khan KM, Mabizela M, Manca A, Milzow K, Mouton J, Muchenje M, Olijhoek T, Ommaya A, Patwardhan B, Poff D, Proulx L, Rodger M, Severin A, Strinzel M, Sylos-Labini M, Tamblyn R, Van Niekerk M, Wicherts JM, Lalu MM. Predatory journals: no definition, no defence. Nature. 2019 Dec 12;576(7786):210–2. DOI: https://doi.org/10.1038/d41586-019-03759-y
Oermann MH, Waldrop J, Nicoll LH, Peterson GM, Drabish KS, Carter-Templeton H, Owens JK, Moorman T, Webb B, Wrigley J. Research on predatory publishing in health care: a scoping review. Can J Nurs Res. 2023;55(4):415–24. DOI: https://doi.org/10.1177/08445621231172621
Moher D, Shamseer L, Cobey KD, Lalu MM, Galipeau J, Avey MT, Ahmadzai N, Alabousi M, Barbeau P, Beck A, Daniel R, Frank R, Ghannad M, Hamel C, Hersi M, Hutton B, Isupov I, McGrath TA, McInnes MDF, Page MJ, Pratt M, Pussegoda K, Shea B, Srivastava A, Stevens A, Thavorn K, Van Katwyk S, Ward R, Wolfe D, Yazdi F, Yu AM, Ziai H. Stop this waste of people, animals and money. Nature. 2017 Sep;549(7670):23–5. DOI: https://doi.org/10.1038/549023a
Bianchini C, Cosentino C, Paci M, Baccini M. Open Access Physical Therapy Journals: Do Predatory Journals Publish Lower-Quality Randomized Controlled Trials? Archives of physical medicine and rehabilitation. 2020 Jun;101(6):969–77. DOI: https://doi.org/10.1016/j.apmr.2019.12.012
Nieminen P, Uribe SE. The quality of statistical reporting and data presentation in predatory dental journals was lower than in non-predatory Journals. Entropy (Basel). 2021 Apr 16;23(4):468. DOI: https://doi.org/10.3390/e23040468
Nwagwu WE, Ojemeni O. Penetration of Nigerian predatory biomedical open access journals 2007–2012: a bibliometric study. Learned Publishing. 2015 Jan;28(1):23–34. DOI: https://doi.org/10.1087/20150105
Oermann MH, Nicoll LH, Carter-Templeton H, Woodward A, Kidayi PL, Neal LB, Edie AH, Ashton KS, Chinn PL, Amarasekara S. Citations of articles in predatory nursing journals. Nursing Outlook. 2019 Nov;67(6):664–70. DOI: https://doi.org/10.1016/j.outlook.2019.05.001
Stephen D. Medical articles in questionable journals are less impactful than those in non-questionable journals but still extensively cited. Scientometrics. 2023;128(8):4509–22. DOI: https://doi.org/10.1007/s11192-023-04763-w
Dodgson JE, Bamberger ET, Haile ZT, Kornegay MKJ. Editorial actions taken to reduce publishing references from predatory sources: a case study. Learn Publ. 2024 Jan 12;37(1):30–8. DOI: https://doi.org/10.1002/leap.1592
Ross-White A, Godfrey CM, Sears KA, Wilson R. Predatory publications in evidence syntheses. Journal of the Medical Library Association. 2019 Jan;107(1):57–61. DOI: https://doi.org/10.5195/jmla.2019.491
Collom CD, Oermann MH, Sabol VK, Heintz PA. An assessment of predatory publication use in reviews. Clin Nurse Spec. 2020;34(4):152–6. DOI: https://doi.org/10.1097/NUR.0000000000000530
Boulos L, Rothfus M, Goudreau A, Manley A. A descriptive study found low prevalence of presumed predatory publications in a subset of Cochrane reviews. J Clin Epidemiol. 2022;152(jce, 8801383):316–25. DOI: https://doi.org/10.1016/j.jclinepi.2022.09.004
Federal Trade Commission. OMICS Group Inc. [Internet]. The Commission. 2020 [cited 2024 Jun 18]. Available from: https://www.ftc.gov/legal-library/browse/cases-proceedings/152-3113-omics-group-inc
Clermont M, Krolak J, Tunger D. Does the citation period have any effect on the informative value of selected citation indicators in research evaluations? Scientometrics. 2021 Feb 1;126(2):1019–47. DOI: https://doi.org/10.1007/s11192-020-03782-1
Akça S, Akbulut M. Are predatory journals contaminating science? An analysis on the Cabells’ Predatory Report. Journal of Academic Librarianship. 2021 Jul;47(4):1. DOI: https://doi.org/10.1016/j.acalib.2021.102366
Kulczycki E, Hołowiecki M, Taşkın Z, Krawczyk F. Citation patterns between impact-factor and questionable journals. Scientometrics. 2021 Oct;126(10):8541–60. DOI: https://doi.org/10.1007/s11192-021-04121-8
Frandsen, Tove Faber. Are predatory journals undermining the credibility of science? A bibliometric analysis of citers. Scientometrics. 2017;113(3):1513–28. DOI: https://doi.org/10.1007/s11192-017-2520-x
Taskin Z, Krawczyk F, Kulczycki E. Are papers published in predatory journals worthless? A geopolitical dimension revealed by content-based analysis of citations. Quant Sci Stud. 2023 Mar 1;4(1):44–67. DOI: https://doi.org/10.1162/qss_a_00242
McVeigh ME, Mann SJ. The Journal Impact Factor denominator: defining citable (counted) items. JAMA. 2009 Sep 9;302(10):1107–9. DOI: https://doi.org/10.1001/jama.2009.1301
Hayden JA. Predatory publishing dilutes and distorts evidence in systematic reviews. Journal of Clinical Epidemiology. 2020 May;121:117–9. DOI: https://doi.org/10.1016/j.jclinepi.2020.01.013
International Committee of Medical Journal Editors. Recommendations for the Conduct, Reporting, Editing, and Publication of Scholarly Work in Medical Journals [Internet]. 2024 [cited 2024 May 27]. Available from: https://www.icmje.org/icmje-recommendations.pdf
COPE Council. Discussion document: Predatory Publishing [Internet]. Committee on Publication Ethics (COPE).; 2019 Nov [cited 2024 May 29]. Available from: https://publicationethics.org/node/45216
Gasparyan AY, Yessirkepov M, Voronov AA, Gerasimov AN, Kostyukova EI, Kitas GD. Preserving the integrity of citations and references by all stakeholders of science communication. Journal of Korean Medical Science. 2015 Nov 1;30(11):1545–52. DOI: https://doi.org/10.3346/jkms.2015.30.11.1545
International Committee of Medical Journal Editors. “Fake,” “Predatory,” and “Pseudo” Journals: Charlatans Threatening Trust in Science [Internet]. 2017 [cited 2024 May 29]. Available from: https://www.icmje.org/news-and-editorials/fake_predatory_pseudo_journals_dec17.html
Additional Files
Published
Issue
Section
License
Copyright (c) 2025 Erin Watson, AHIP, Li Zhang
This work is licensed under a Creative Commons Attribution 4.0 International License.
