A systematic approach to searching: an efficient and complete method to develop literature searches

Wichor M. Bramer, Gerdien B. de Jonge, Melissa L. Rethlefsen, Frans Mast, Jos Kleijnen


Creating search strategies for systematic reviews, finding the best balance between sensitivity and specificity, and translating search strategies between databases is challenging. Several methods describe standards for systematic search strategies, but a consistent approach for creating an exhaustive search strategy has not yet been fully described in enough detail to be fully replicable. The authors have established a method that describes step by step the process of developing a systematic search strategy as needed in the systematic review. This method describes how single-line search strategies can be prepared in a text document by typing search syntax (such as field codes, parentheses, and Boolean operators) before copying and pasting search terms (keywords and free-text synonyms) that are found in the thesaurus. To help ensure term completeness, we developed a novel optimization technique that is mainly based on comparing the results retrieved by thesaurus terms with those retrieved by the free-text search words to identify potentially relevant candidate search terms. Macros in Microsoft Word have been developed to convert syntaxes between databases and interfaces almost automatically. This method helps information specialists in developing librarian-mediated searches for systematic reviews as well as medical and health care practitioners who are searching for evidence to answer clinical questions. The described method can be used to create complex and comprehensive search strategies for different databases and interfaces, such as those that are needed when searching for relevant references for systematic reviews, and will assist both information specialists and practitioners when they are searching the biomedical literature.


Review Literature as Topic; Databases, Bibliographic; Information Storage and Retrieval; Vocabulary, Controlled

Full Text:



Harris MR. The librarian’s roles in the systematic review process: a case study. J Med Libr Assoc. 2005 Jan;93(1):81–7.

Higgins JPT, Green S, eds. Cochrane handbook for systematic reviews of interventions: Wiley Online Library; 2008.

University of York, N.H.S. Centre for Reviews and Dissemination. Systematic reviews: CRD’s guidance for undertaking reviews in health care. York, UK: CRD, University of York; 2009.

Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009 Sep;62(9):944–52.

Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009 Oct;62(10):1006–12.

Chandler J, Churchill R, Higgins J, Lasserson T, Tovey D. Methodological standards for the conduct of new Cochrane intervention reviews. The Cochrane Library; 2013.

Saleh AA, Ratajeski MA, Bertolet M. Grey literature searching for health sciences systematic reviews: a prospective study of time spent and resources utilized. Evid Based Libr Inf Pract. 2014;9(3):28–50.

Erwin PJ. By the clock: how much time does an expert search take? [expert searching]. MLA News. 2004 Oct;(370):1, 12.

Bramer WM, Rethlefsen ML, Mast F, Kleijnen J. A pragmatic evaluation of a new method for librarian-mediated literature searches for systematic reviews. Submitted. 2017.

Riva JJ, Malik KM, Burnie SJ, Endicott AR, Busse JW. What is your research question? an introduction to the PICOT format for clinicians. J Can Chiropr Assoc. 2012 Sep;56(3):167–71.

Stern C, Jordan Z, McArthur A. Developing the review question and inclusion criteria. Am J Nurs. 2014 Apr;114(4):53–6.

Thabane L, Thomas T, Ye C, Paul J. Posing the research question: not so simple. Can J Anaesth. 2009 Jan;56(1):71–9.

Bramer WM. Patient, intervention, comparison, outcome (PICO): an overrated tool [expert searching]. MLA News. 2015 Feb;55(2):6.

Schardt C, Adams MB, Owens T, Keitz S, Fontelo P. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Med Inform Decis Mak. 2007 Jun 15;7:16.

Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv Res. 2014 Nov 21;14:579.

Bramer WM, Giustini D, Kramer BMR. Comparing the coverage, recall, and precision of searches for 120 systematic reviews in Embase, MEDLINE, and Google Scholar: a prospective study. Syst Rev. 2016 Mar 1;5:39.

Elsevier R&D Solutions. A comparison of Emtree® and MeSH® [whitepaper] [Internet]. Elsevier; 2015 [updated Jul 2015; cited 23 Nov 2015]. .

Institute of Medicine, Committee on Standards for Systematic Reviews of Comparative Effectiveness Research, Eden J, Levit LA, Berg AO, Morton SC. Finding what works in health care standards for systematic reviews [Internet]. Washington, DC: National Academies Press; 2011 [cited 13 Jul 2018]. .

Niederstadt C, Droste S. Reporting and presenting information retrieval processes: the need for optimizing common practice in health technology assessment. Int J Technol Assess Health Care. 2010 Oct;26(04):450–7.

Rader T, Mann M, Stansfield C, Cooper C, Sampson M. Methods for documenting systematic review searches: a discussion of common issues. Res Synth Methods. 2014 Jun;5(2):98–115.

Hammerstrøm K, Wade A, Jørgensen AMK. Searching for studies: a guide to information retrieval for Campbell Systematic Reviews. The Campbell Collaboration; 2010.

Anderson LM, Oliver SR, Michie S, Rehfuess E, Noyes J, Shemilt I. Investigating complexity in systematic reviews of interventions by using a spectrum of methods. J Clin Epidemiol. 2013 Nov;66(11):122–9.

Watine J, Couaillac JP, Lepargneur JP, Augereau C, Bunting PS, Oosterhuis WP. Evidence-based medicine (EBM) and clinical practice guidelines (CPG): about three misconceptions. Immuno-Analyse et Biologie Specialisee. 2012;27(5):279–82.

Cooke A, Smith D, Booth A. Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res. 2012 Oct;22(10):1435-43.

Bramer WM, Giustini D, Kramer BM, Anderson PF. The comparative recall of Google Scholar versus PubMed in identical searches for biomedical systematic reviews: a review of searches used in systematic reviews. Syst Rev. 2013 Dec 23;2:115.

DOI: https://doi.org/10.5195/jmla.2018.283


  • There are currently no refbacks.

Copyright (c) 2018 Wichor M. Bramer, Gerdien B de Jonge, Melissa L Rethlefsen, Frans Mast, Jos Kleijnen

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.