Development and validation of LGBTQIA+ search filters: Report on process and pilot filter for queer women

Authors

DOI:

https://doi.org/10.5195/jmla.2025.2002

Keywords:

LGBTQIA, lesbians, women who have sex with women, WSW, queer women, bisexual women, search hedge validation, search filter validation, relative recall, systematic reviews as topic

Abstract

Introduction: A search filter for studies involving lesbian, gay, bisexual, transgender, queer, intersex, asexual, and additional sexual minority and gender identities (LGBTQIA+) populations has been developed and validated; however, the filter contained very small gold standard sets for some populations, and terminology, controlled vocabulary, and database functionality has subsequently evolved. We therefore sought to update and re-test the search filters for these selected subgroups using larger gold standard sets. We report on the development and validation of two versions of a sensitivity maximizing search filter for queer women, including but not limited to lesbians and women who have sex with women (WSW).

Methods: We developed a PubMed search filter for queer women using the relative recall approach and incorporating input from queer women. We tested different search combinations against the gold standard set; combinations were tested until a search with 100 percent sensitivity was identified.

Results: We developed and tested variations of the search, and present two versions of the strategy with 99% and 100% sensitivity. The strategies included additional terms to improve sensitivity and proximity searching to improve recall and precision.

Conclusions: The queer women search filters balance sensitivity and precision to facilitate comprehensive retrieval of studies involving queer women. The filters will require ongoing updates to adapt to evolving language and search platform functionalities. Strengths of the study include the involvement of the population of interest at each stage of the project. Future research will include development and testing of search filters for other LGBTQIA+ subgroups such as bisexual and transgender people.

References

Sell R, Conron K. Definitions: ‘Straight, that is not gay’: Moving beyond binary notions of sexual and gender identities. In: Stall R, Dodge B, Bauermeister JA, Poteat T, Beyrer C, eds. LGBTQ health research: Theory, methods, practice. Baltimore, MD: Johns Hopkins University Press; 2020. 61-90.

Eliason MJ. An exploration of terminology related to sexuality and gender: Arguments for standardizing the language. 2014. 29(2):162-175. https://doi.org/10.1080/19371918.2013.775887.

White VJ, Glanville JM, Lefebvre C, Sheldon TA. A statistical approach to designing search filters to find systematic reviews: Objectivity enhances accuracy. J Inf Sci. 2001. 27(6):357–370. https://doi.org/10.1177/016555150102700601.

Jenkins M. Evaluation of methodological search filters - A review. Health Info Libr J. 2004. 21(3):148-163. https://doi.org/10.1111/j.1471-1842.2004.00511.x.

Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, Klassen TP, Moher D. An alternative to the hand searching gold standard: validating methodological search filters using relative recall. BMC Med Res Methodol. 2006. 6(33). https://doi.org/10.1186/1471-2288-6-33.

Lee JGL, Ylioja T, Lackey M. Identifying lesbian, gay, bisexual, and transgender search terminology: A systematic review of health systematic reviews. PloS one. 2016. 11(5):e0156210. https://doi.org/10.1371/journal.pone.0156210.

Parker RMN, Wanner A, Foster M, Lackey M. Design & Validation of Search Filters for LBGTQ+ Populations. Cochrane Colloquium Edinburgh. September 17, 2018, Edinburgh, Scotland. https://colloquium2018.cochrane.org/abstracts/design-and-validation-search-filter-lgbtq-populations.

Glanville J , Bayliss S, Booth A, Dundar Y, Fernandes H, Fleeman ND, Foster L, Fraser C, Fry-Smith A, Golder S, Lefebvre C, Miller C, Paisley S, Payne L, Price A, Welch K. So many filters, so little time: The development of a Search Filter Appraisal Checklist. Journal of the Medical Library Association. 2008; 96(4): 356-61.

Weeks A, Nugent R, Orozco R, Roth S, Fell S, Hoskins K, Shields T, Abad E, Vidales J, Corn M, Hanneke R, Lackey M, Lokker C, Navarro-Ruan T, Ramirez M, Scheinfeld L, Burns H. Hispanic/Latinx Inclusive Terminologies Projects Action Plan [Internet]. 2021. [cited 12 Apr 2024]. https://osf.io/6myqs.

HRC Foundation. Glossary of Terms [Internet]. Human Rights Campaign. [cited 21 Oct 2024]. https://www.hrc.org/resources/glossary-of-terms.

Salvador-Oliván JA, Marco-Cuenca G, Arquero-Avilés R. Development of an efficient search filter to retrieve systematic reviews from PubMed. J Med Libr Assoc. 2021. 109(4):561–574. https://doi.org/10.5195/jmla.2021.1223.

Veritas Health Innovation. Covidence Systematic Review Software [Internet]. 2024. [cited 12 Apr 2024]. www.covidence.org.

National Library of Medicine. PubMed update: Proximity search now available in PubMed. NLM Tech Bull. 2022. Nov-Dec(449): e4. https://www.nlm.nih.gov/pubs/techbull/nd22/nd22_pubmed_proximity_search_available.html.

Bachmann LM, Coray R, Estermann P, Ter Riet G. Identifying diagnostic studies in MEDLINE: reducing the number needed to read. J Am Med Inform Assoc. 2002. 9(6):653-658. doi:10.1197/jamia.m1124.

Weeks A, Hoskins K. Hispanic/Latinx Inclusive Terminologies Projects Technical Report [Internet]. 2022. [cited 12 Apr 2024]. https://digitalscholarship.unlv.edu/lib_articles/735.

Schilperoort H, Hickner A, Parker R, Foster M, Misquith C, Morgan-Daniel J, Saylor K, Shields T, Toole F. Update and Re-Validation of Search Filters for LGBTQIA+ Populations [Internet]. Open Science Framework. 2023. https://osf.io/fnkq2.

Hanneke R, Brunskill A. Searching for the social determinants of health: observations from evidence synthesis publications. Syst Rev 13, 134 (2024).

National Library of Medicine. Automated indexing FAQs [Internet]. 2024. [cited 9 Oct 2024]. https://support.nlm.nih.gov/kbArticle/?pn=KA-05326

Chen E, Bullard J, Giustini D. Automated indexing using NLM's Medical Text Indexer (MTI) compared to human indexing in Medline: A pilot study. J Med Libr Assoc. 2023. 111(3): 684–694. https://doi.org/10.5195/jmla.2023.1588.

Taubman Library. Language Matters: Handling Tough Terms in Systematic Searching [Internet]. 2024. [cited 12 Apr 2024]. https://guides.lib.umich.edu/TaubmanTalks/ToughTerms.

Downloads

Published

2025-04-18

Issue

Section

Original Investigation