"Is this professionally correct?": understanding the criteria nurses use to evaluate information

Authors

DOI:

https://doi.org/10.5195/jmla.2025.2163

Keywords:

Information Literacy, Nurses, Evidence-Based Nursing, Evidence-Based Practice, Evaluation Criteria, Critical Appraisal

Abstract

Objective: Nurses must evaluate and sift through large quantities of information of varying quality as part of patient care. This study sought to determine nurses' evaluation criteria when encountering health information, including consumer health information written for the general public and scholarly sources, such as journal articles. 

Methods: We employed a mixed-methods approach with a survey and follow-up individual interviews. In both the survey and interviews, nurses were asked to evaluate information written for the general public or a scholarly audience. Interviewees were encouraged to think aloud to elucidate their criteria. We analyzed data using descriptive statistics and inductive thematic analysis. 

Results: Criteria used for both consumer and scholarly information were similar, with accuracy, relevance, authority, purpose, and currency as the most frequently reported. Nurses often relied on easily identifiable characteristics, such as where information came from, funding sources, intended audience, or its concordance with their prior knowledge. Nurses demonstrated awareness of the need to evaluate methodology in studies, especially empirical studies, for accuracy and relevance. However, they were less likely to evaluate methodology in review articles. 

Conclusions: Nurses value accurate, relevant information; however, their evaluation criteria are often superficial. Educators should encourage nursing students to engage more deeply with the nuances of evaluation. While many nurses pointed to research and peer review as evidence of accuracy, fewer demonstrated a deeper understanding of how to evaluate particular research methodologies, such as systematic reviews.

Author Biographies

Brandon Patterson, University of Utah

Brandon Patterson is the Technology Engagement Librarian at the Eccles Health Sciences Library at the University of Utah. He connects students, staff, and faculty to digital tools and emerging technologies and creates meaningful experiences using prototyping tools, virtual reality and online learning platforms. He is a health sciences education liaison and coordinates with faculty to incorporate information literacy instruction and technology into their classrooms.

Anne R.Diekema, Southern Utah University

Anne Diekema is an Assistant Professor, Department Chair, and Instruction and Outreach Librarian at the Gerald R. Sherratt Library at Southern Utah University. Anne’s teaching emphasis is on information literacy. Her research specialization is in human information behavior where she studies how certain groups of people (nurses, educators, students) search, organize, use and manage information, with the goal to improve teaching and learning. Anne is the liaison librarian to the Department of Nursing and the Department of Biology.

Elizabeth (Betsy) S. Hopkins, Brigham Young University

Betsy Hopkins is the Nursing Librarian at the Harold B. Lee Library at Brigham Young University, where she provides reference, collection management, instruction, and faculty liaison services. Information literacy is Betsy’s area of focus, both in practice and research. She is always looking for ways to improve student engagement and learning.

Duane Wilson, Brigham Young University

Assessment Facilitator, Harold. B Lee Library, Brigham Young University, Provo, UT

Nena Schvaneveldt, University of Utah

Nena Schvaneveldt is an Education Librarian at the Spencer S. Eccles Health Sciences Library at the University of Utah, where she provides curricular-integrated instruction in information literacy, focusing on developing lifelong learning skills and mindsets. She is interested in improving information literacy education of health sciences students.

References

Straus SE, Glasziou P, Richardson WS, Haynes RB. Evidence-based medicine: how to practice and teach EBM. 5th ed. ed. Edinburgh, UK: Elsevier; 2018.

American Association of Colleges of N. The Essentials: Core Competencies for Professional Nursing Education. 2021.

Bell SG. Evidence-Based Practice Competencies for RNs and APNs: How Are We Doing? Neonatal Netw. 2020;39(5):299-302. DOI: https://dx.doi.org/10.1891/0730-0832.39.5.299

Capet P, Delavallade T, eds. Information evaluation. Hoboken, NJ: John Wiley & Sons; 2013.

Diviani N, Obrenovic J, Montoya CL, Karcz K. Disentangling health information appraisal competence: Results from an interdisciplinary scoping review and online consultation among Swiss stakeholders. PLoS One. 2020;15(7). DOI: https://dx.doi.org/10.1371/journal.pone.0235474

White R, Taylor S. Nursing practice should be informed by the best available evidence, but should all first-level nurses be competent at research appraisal and utilization? Nurse Educ Today. 2002;22(3):220-4.

Schvaneveldt N, Diekema AR, Hopkins ES, Patterson B. New nurses apply only basic source evaluation criteria but realize their skills are lacking: More sophisticated approaches to teaching evaluation skills are required. Health information and libraries journal. 2022 39(2):166-77. DOI: https://doi.org/10.1111/hir.12395

Carter-Templeton HD. Nurses' information appraisal within the clinical setting [Dissertation]: University of Tennessee; 2011.

Grøn RR, Christiansen CE, Strøm J, Høybye MT. The practice of information appraisal: An ethnographic study of a health information intervention. Health. 2024 28(6):812-30. DOI: https://dx.doi.org/10.1177/13634593231204173

Aharon AA, Ruban A, Dubovi I. Knowledge and information credibility evaluation strategies regarding COVID-19: A cross-sectional study. Nurs Outlook. 2020;69(1):22-31. DOI: https://dx.doi.org/10.1016/j.outlook.2020.09.001

Robillard JM, Jun JH, Lai J-A, Feng TL. The QUEST for quality online health information: Validation of a short quantitative tool. BMC Med Inform Decis Mak. 2018;18(1):87. DOI: https://doi.org/10.1186/s12911-018-0668-9

Stars I, Rubene Z. A phenomenographic study of adolescents’ conceptions of health information appraisal as a critical component of adolescent health literacy. Acta Paedagog Vilnensia. 2020;44:62-80. DOI: https://doi.org/10.15388/ActPaed.44.5

Dang D, Dearholt SL, Bissett K, Ascenzi J, Whalen M. Johns Hopkins evidence-based practice for nurses and healthcare professionals: model and guidelines. 4th ed. Indianapolis, IN: Sigma Theta Tau; 2021.

Spruce L, Van Wicklin SA, Hicks RW, Conner R, Dunn D. Introducing AORN's new model for evidence rating. AORN J. 2014;99(2):243-55. DOI: https://doi.org/10.1016/j.aorn.2013.11.014

Meola M. Chucking the checklist: A contextual approach to teaching undergraduates web-site evaluation. portal: Libr Acad. 2004;4(3):331-44.

Duffy ME. A research appraisal checklist for evaluating nursing research reports. Nurs Health Care. 1985;6(10):538-47.

Russo A, Jankowski A, Beene S, Townsend L. Strategic source evaluation: Addressing the container conundrum. Ref Serv Rev. 2019;47(3):294-313. DOI: https://doi.org/10.1108/RSR-04-2019-0024

Buccheri RK, Sharifi C. Critical appraisal tools and reporting guidelines for evidence-based practice. Worldviews Evid Based Nurs. 2017;14(6):463-72. DOI: https://doi.org/10.1111/wvn.12258

Tomotaki A, Sakai I, Fukahori H, Tsuda Y, Okumura‐Hiroshige A. Factors affecting the critical appraisal of research articles in evidence‐based practices by advanced practice nurses: A descriptive qualitative study. Nurs Open. 2023;10(6):3719. DOI: https://doi.org/10.1002/nop2.1628

Kirshbaum M, Beaver K, Luker KA. Perspectives of breast care nurses on research dissemination and utilisation. Clin Eff Nurs. 2004;8(1):47-58.

Jelsness-Jørgensen L-P. Does a 3-week critical research appraisal course affect how students perceive their appraisal skills and the relevance of research for clinical practice? A repeated cross-sectional survey. Nurse Educ Today. 2015;35(1):e1-5. DOI: https://doi.org/10.1016/j.nedt.2014.09.008

Sleutel MR, Bullion JW, Sullivan R. Tools of the trade: Improving nurses’ ability to access and evaluate research. J Nurs Manag. 2018;26(2):167-71. DOI: https://doi.org/10.1111/jonm.12529

Scott SD, Gilmour J, Fielden J. Nursing students and internet health information. Nurse Educ Today. 2008;28(8):993-1001. DOI: https://doi.org/10.1016/j.nedt.2008.06.002

Diekema AR, Hopkins ES, Patterson B, Schvaneveldt N. Listening to Alumni Voices to Enhance Disciplinary Information Literacy Instruction. In: Enakshi Sengupta, Patrick Blessinger, and Milton D. Cox, editors. International Perspectives on Improving Student Engagement: Advances in Library Practices in Higher Education. Innovations in Higher Education Teaching and Learning. 26: Emerald Publishing Limited; 2020. p. 129-43.

Bala MM, Peričić TP, Zajac J, Rohwer A, Klugarova J, Välimäki M, Lantta T, Pingani L, Klugar M, Clarke M, Young T. What are the effects of teaching Evidence-Based Health Care (EBHC) at different levels of health professions education? An updated overview of systematic reviews. PLoS One. 2021;16(7):e0254191. DOI: https://dx.doi.org/10.1371/journal.pone.0254191

Jeong D, Park C, Sugimoto K, Jeon M, Kim D, Eun Y. Effectiveness of an evidence-based practice education program for undergraduate nursing students: A systematic review and meta-analysis. Int J Environ Res Public Health. 2024;21(5):637. DOI: https://dx.doi.org/10.3390/ijerph21050637

Sapri ND, Ng YT, Wu VX, Klainin-Yobas P. Effectiveness of educational interventions on evidence-based practice for nurses in clinical settings: A systematic review and meta-analysis. Nurse Educ Today. 2022;111:105295. DOI: https://dx.doi.org/10.1016/j.nedt.2022.105295

Blakeslee S. The CRAAP test. LOEX Q. 2004 31(3):6-7.

Caulfield M. SIFT (the four moves). 19 Jun 2019 [12 Feb 2025]. In: Hapgood [Internet]. Available from: https://hapgood.us/2019/06/19/sift-the-four-moves/.

Greenhalgh T. How to read a paper: the basics of evidence-based medicine and healthcare. 6th ed. Hoboken, NJ: John Wiley & Sons; 2019.

Pravikoff DS, Tanner AB, Pierce ST. Readiness of U.S. nurses for evidence-based practice. Am J Nurs. 2005 105(9):40-51.

Sharun S. Practicing information literacy: Practicum students negotiating information practice in workplace settings. J Acad Librar. 2021;47(1):102267. DOI: https://doi.org/10.1016/j.acalib.2020.102267

Nicholas D, Williams P, Smith A, Longbottom P. The information needs of perioperative staff: a preparatory study for a proposed specialist library for theatres (NeLH). Health information and libraries journal. 2005; 22(1):35-43. DOI: https://doi.org/10.1111/j.1471-1842.2005.00535.x

Seo H, Blomberg M, Altschwager D, Vu HT. Vulnerable populations and misinformation: A mixed-methods approach to underserved older adults’ online information assessment. New Media Soc. 2020;46144482092504. DOI: https://doi.org/10.1177/1461444820925041

Phelps SF, Hyde L, Wolf JP. Introducing Information Literacy Competency Standards for Nursing. Nurse Educ. 2015 40(6):278-80. DOI: https://dx.doi.org/1097/NNE.0000000000000170

Holliday W, Rogers J. Talking about information literacy: The mediating role of discourse in a college writing classroom. portal: Libr Acad. 2013;13(3):257-71.

Walters WH, Wilder EI. Fabrication and errors in the bibliographic citations generated by ChatGPT. Sci Rep. 2023; 13(1):14045. https://doi.org/10.1038/s41598-023-41032-5. DOI: 10.1038/s41598-023-41032-5

Caulfield M, Wineburg S. Verified: How to think straight, get duped less, and make better decisions about what to believe online. Chicago, IL: University of Chicago Press; 2023.

American Association of Colleges of Nursing. Nursing Workforce Fact Sheet. 2024 April [9 May 2025]. In: AACN Fact Sheets. Available from: https://www.aacnnursing.org/news-data/fact-sheets/nursing-workforce-fact-sheet.

Cantwell LP, McGowan BS, Planchon Wolf J, Slebodnik M, Conklin JL, McCarthy S, Raszewski R. Building a bridge: a review of information literacy in nursing education. J Nurs Educ. 2021;60(8):431-6. DOI: https://dx.doi.org/10.3928/01484834-20210722-03

McGowan BS, Cantwell LP, Conklin JL, Raszewski R, Wolf JP, Slebodnik M, McCarthy S, Johnson S. Evaluating nursing faculty's approach to information literacy instruction: a multi-institutional study. J Med Lib Assn. 2020;108(3):378-88. DOI: https://dx.doi.org/10.5195/jmla.2020.841

Downloads

Published

2025-10-23

Issue

Section

Original Investigation