The case of the disappearing librarians: analyzing documentation of librarians’ contributions to systematic reviews
Keywords:systematic reviews, Librarians, documentation
Objective: The study aimed to analyze the documented role of a librarian in published systematic reviews and meta-analyses whose registered protocols mentioned librarian involvement. The intention was to identify how, or if, librarians’ involvement was formally documented, how their contributions were described, and if there were any potential connections between this documentation and basic metrics of search reproducibility and quality.
Methods: Reviews whose PROSPERO protocols were registered in 2017 and 2018 and that also specifically mentioned a librarian were analyzed for documentation of the librarian’s involvement. Language describing the librarian and their involvement was gathered and coded, and additional information about the review, including search strategy details, was also collected.
Results: A total of 209 reviews were found and analyzed. Of these, 28% had a librarian co-author, 41% named a librarian in the acknowledgements section, and 78% mentioned the contribution of a librarian within the body of the review. However, mentions of a librarian within the review were often generic (“a librarian”) and in 31% of all reviews analyzed no librarian was specified by name. In 9% of the reviews, there was no reference to a librarian found at all.
Conclusions: Even among this set of reviews, where librarian involvement was specified at the protocol level, librarians’ contributions were often described with minimal, or even no, language in the final published review. Much room for improvement appears to remain in terms of how librarians’ work is documented.
Bullers K, Howards AM, Hanson A, Kearns WD, Orriola J, Polo R, Sakmar K. It takes longer than you think: librarian time spent on systematic review tasks. J Med Libr Assoc. 2018;106(2):198–207. DOI: https://doi.org/10.5195/jmla.2018.323.
Spencer AJ, Eldredge JD. Roles for librarians in systematic reviews: a scoping review. J Med Libr Assoc. 2018;106(1):46–56. DOI: https://doi.org/10.5195/jmla.2018.82.
Desmeules R, Dorgan M, Campbell S. Acknowledging Librarians’ Contributions to Systematic Review Searching. J Can Health Libr Assoc. 2016 Aug;37(2):44–52. DOI: https://doi.org/10.5596/c16-014.
Aamodt M, Huurdeman H, Strømme H. Librarian co-authored systematic reviews are associated with lower risk of bias compared to systematic reviews with acknowledgement of librarians or no participation by librarians. Evid Based Libr Inf Pract. 2019 Dec;14(4):103–27. DOI: https://doi.org/10.18438/eblip29601.
Meert D, Torabi N, Costella J. Impact of librarians on reporting of the literature searching component of pediatric systematic reviews. J Med Libr Assoc. 2016;104(4):267–77. DOI: https://doi.org/10.3163/1536-5050.104.4.004.
Rethlefsen ML, Farrell AM, Trzasko LCO, Brigham TJ. Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews. J Clin Epidemiol. 2015;68(6):617–26. DOI: https://doi.org/10.1016/j.jclinepi.2014.11.025.
Ross-White A. Search is a verb: systematic review searching as invisible labor. J Med Libr Assoc. 2021 Oct 5;109(3). DOI: https://doi.org/10.5195/jmla.2021.1226.
Eskrootchi R, Mohammadi AS, Panahi S, Zahedi R. Librarians’ participation in the systematic reviews published by Iranian researchers and its impact on the quality of reporting search strategy. Evid Based Libr Inf Pract. 2020 Apr;15(2):69–84. DOI: https://doi.org/10.18438/eblip29609.
Koffel JB. Use of recommended search strategies in systematic reviews and the impact of librarian involvement: a cross-sectional survey of recent authors. PloS One. 2015;10(5):e0125931. DOI: https://doi.org/10.1371/journal.pone.0125931.
Nicholson J, McCrillis A, Williams JD. Collaboration challenges in systematic reviews: a survey of health sciences librarians. J Med Libr Assoc. 2017;105(4):385–93. DOI: https://doi.org/10.5195/jmla.2017.176.
Healy HS, Regan M, Deberg J. Examining the reach and impact of a systematic review service. Med Ref Serv Q. 2020 Apr;39(2):125–38. DOI: https://doi.org/10.1080/02763869.2020.1726150.
Ross-White A. An environmental scan of librarian involvement in systematic reviews at Queen’s University: 2020 update. J Can Health Libr Assoc. 2021 Aug 1;42(2). DOI: https://doi.org/10.29173/jchla29517.
PROSPERO [Internet]. [cited 2022 Feb 4]. https://www.crd.york.ac.uk/prospero/.
Best practice in systematic reviews: the importance of protocols and registration. PLoS Med. 2011 Feb 22;8(2):e1001009. DOI: https://doi.org/10.1371/journal.pmed.1001009.
Farrah K, Young K, Tunis MC, Zhao L. Risk of bias tools in systematic reviews of health interventions: an analysis of PROSPERO-registered protocols. Syst Rev. 2019;8(1). DOI: https://doi.org/10.1186/s13643-019-1172-8.
Hu K, Zhao L, Zhou Q, Mei F, Gao Q, Chen F, Jiang M, Zhao B, Zhang W, Kwong JSW, Ma Y, Mou C, Ma B. Inconsistencies in study eligibility criteria are common between non-Cochrane systematic reviews and their protocols registered in PROSPERO. Res Synth Methods. 2021 May;12(3):394-405. DOI: https://doi.org/10.1002/jrsm.1476.
Booth A, Mitchell AS, Mott A, James S, Cockayne S, Gascoyne S, McDaid C. An assessment of the extent to which the contents of PROSPERO records meet the systematic review protocol reporting items in PRISMA-P. F1000Res. 2020;9. DOI: https://doi.org/10.12688/f1000research.25181.2.
Delgado AF, De Luca F, Hanagandi P, Van Westen D. Arterial spin-labeling in children with brain tumor: a meta-analysis. AJNR Am J Neuroradiol. 2018 Aug 1;39(8):1536-42. DOI: https://doi.org/ 10.3174/ajnr.A5727.
Rietbergen T, Spoon D, Brunsveld-Reinders AH, Schoones JW, Huis A, Heinen M, Persoon A, van Dijk M, Vermeulen H, Ista E, van Bodegom-Vos L. Effects of de-implementation strategies aimed at reducing low-value nursing procedures: a systematic review and meta-analysis. Implement Sci. 2020 Dec;15(1):1-8. DOI: https://doi.org/10.1186/s13012-020-00995-z.
Øverås CK, Johansson MS, de Campos TF, Ferreira ML, Natvig B, Mork PJ, Hartvigsen J. Distribution and prevalence of musculoskeletal pain co-occurring with persistent low back pain: a systematic review. BMC Musculoskelet Disord. 2021 Jan;22(1):91. DOI: https://doi.org/10.1186/s12891-020-03893-z.
PRISMA [Internet]. [cited 2022 Feb 8]. http://www.prisma-statement.org.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009 Jul 21;339:b2535. DOI: https://doi.org/10.1136/bmj.b2535
Kirtley S. Increasing value and reducing waste in biomedical research: librarians are listening and are part of the answer. Lancet. 2016;387(10028):1601. DOI: https://doi.org/10.1016/S0140-6736(16)30241-0.
Opheim E, Andersen PN, Jakobsen M, Aasen B, Kvaal K. Poor quality in systematic reviews on PTSD and EMDR – an examination of search methodology and reporting. Front Psychol. 2019 [cited 2022 Jan 26];10. DOI: https://doi.org/10.3389/fpsyg.2019.01558.
Le JT, Qureshi R, Twose C, Rosman L, Han G, Fapohunda K, Saldanha IJ, Scherer RW, Lum F, Al-Rajhi A, Musch DC, Hawkins BS, Dickersin K, Li T. Evaluation of systematic reviews of interventions for retina and vitreous conditions. JAMA Ophthalmol. 2019 Dec 1;137(12):1399–405. DOI: https://doi.org/10.1001/jamaophthalmol.2019.4016.
ICMJE | Recommendations | Defining the role of authors and contributors [Internet]. [cited 2022 Mar 4]. http://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html.
Runjic E, Rombey T, Pieper D, Puljak L. Half of systematic reviews about pain registered in PROSPERO were not published and the majority had inaccurate status. J Clin Epidemiol. 2019;116:114–21. DOI: https://doi.org/10.1016/j.jclinepi.2019.08.010.
Khaleel S, Cleveland B, Kalapara A, Sathianathen N, Balaji P, Dahm P. The fate of urological systematic reviews registered in PROSPERO. World J Urol. 2020;38(11):2981–6. DOI: https://doi.org/10.1007/s00345-019-03032-x.
Rombey T, Doni K, Hoffmann F, Pieper D, Allers K. More systematic reviews were registered in PROSPERO each year, but few records’ status was up-to-date. J Clin Epidemiol. 2020;117:60–7. DOI: https://doi.org/10.1016/j.jclinepi.2019.09.026.
Rethlefsen ML, Kirtley S, Waffenschmidt S, Ayala AP, Moher D, Page MJ, Koffel JB. PRISMA-S: an extension to the PRISMA statement for reporting literature searches in systematic reviews. Syst Rev. 2021;10(1):1–19. DOI: https://doi.org/10.1186/s13643-020-01542-z.
PRISMA [Internet]. PRISMA for searching. [cited 2022 Feb 8]. http://www.prisma-statement.org/Extensions/Searching.
Iverson S, Della Seta M, Lefebvre C, Ritchie A, Traditi L, Baliozian K. International health library associations urge the ICMJE to seek information specialists as peer reviewers for knowledge synthesis publications. J Med Libr Assoc. 2021 Jul;109(3):503–4. DOI: https://doi.org/10.5195/jmla.2021.1301.
Roth S, Dean W. A new partnership: an institutional repository and a systematic review search deposit service. Medical Institutional Repositories in Libraries (MIRL) [Internet]. 2021 Nov 17. https://hsrc.himmelfarb.gwu.edu/mirl/2021/program/38.
Copyright (c) 2022 Amelia Brunskill, Rosie Hanneke
This work is licensed under a Creative Commons Attribution 4.0 International License.