Early explorations of holistic review in graduate medical education
DOI:
https://doi.org/10.5195/jmla.2025.2030Keywords:
Holistic review, Graduate medical education, Internship and residency, School admission criteria, Health care disparities, Cultural diversity, Population groups, Personnel selection, Social determinants of health, Social justiceAbstract
Background: Graduate Medical Education programs have implemented holistic review to improve the selection process for new residents. Holistic review will have a profound effect on Health Information Professionals (HIPs) with the arrival of medical residents with different backgrounds and needs. The unique experiences and skills of HIPs will position them well for the new realities in medical residency programs. This article traces the historic roots of holistic review.
Methods: The authors employed a scoping review to track the historical traces of holistic review in Graduate Medical Education over the formative period of 1999-2019.
Results: Medical residency programs over a 20-year period piloted holistic review in the screening, interview, and multiple time periods in the selection process. These ventures reflected a diversity of approaches and creative adaptations from other disciplines such as personnel management, organizational psychology, and active learning forms of education
Conclusion: Health information professionals and medical educators will better engage with the newer cohorts of residents when equipped with a history of holistic review.
References
Jones DA. Management of and issues specific to hospital libraries. In: Introduction to health sciences librarianship. Wood MS, ed. New York, NY: The Haworth Press, 2008: 341-67.
Henderson ME. New roles and new horizons for health sciences librarians and libraries. In: Health sciences librarianship. Wood MS, ed. Chicago, IL: Medical Library Association and Lanham, D: Rowman & Littlefield, 2014: 403-18.
Rhue DJ, Eldredge JD. Medical Residency Milestones: Competencies in Informatics, Library, and Evidence-Based Practice. Med Ref Serv Q. 2022;41(3):236-247. doi:10.1080/02763869.2022.2093545
Samek T. Intellectual Freedom and Social Responsibility in American Librarianship, 1967-1974. McFarland; 2001.
Freeman RS, Hovde DM. Libraries to the People: Histories of Outreach. McFarland & Co.; 2003.
Baker D, Evans W. Libraries, society, and social responsibility. In: Libraries and society: role, responsibility and future in an age of change. DP Baker, ed. New York, NY: Elsevier Science & Technology. Accessed July 6, 2024. http://site.ebrary.com/id/10816534.
Schuessler J. Helping black culture rise upon a mountain of books. New York Times. Weekend Arts. 2024 Jul 7: C1 & C8-C9.
Association of American Medical Colleges. Holistic Review. Available from: <https://www.aamc.org/services/member-capacity-building/holistic-review >. Accessed 30 May 2024.
McDade WA. Increasing Graduate Medical Education Diversity and Inclusion. J Grad Med Educ. 2019;11(6):736-738. doi:10.4300/JGME-D-19-00760.1
Chae SH. Is the match illegal? N Engl J Med. 2003;348(4):352-356. doi:10.1056/NEJMsb021241
Wright AA, Katz IT. Match point? N Engl J Med. 2004;351(12):1165-1167. doi:10.1056/NEJMp048122
Hendren WH. Is the match illegal? N Engl J Med. 2003;348(22):2259-2262.
Carmody JB. On Residency Selection and the Quantitative Fallacy. J Grad Med Educ. 2019;11(4):420-421. doi:10.4300/JGME-D-19-00453.1
O'Mahony S. Medicine and the McNamara fallacy. J R Coll Physicians Edinb. 2017;47(3):281-287. doi:10.4997/JRCPE.2017.315
Lombardi CV, Chidiac NT, Record BC, Laukka JJ. USMLE step 1 and step 2 CK as indicators of resident performance. BMC Med Educ. 2023;23(1):543. Published 2023 Jul 31. doi:10.1186/s12909-023-04530-8
Moynahan KF. The Current Use of United States Medical Licensing Examination Step 1 Scores: Holistic Admissions and Student Well-Being Are in the Balance. Acad Med. 2018;93(7):963-965. doi:10.1097/ACM.0000000000002101
Salari S, Deng F. A Stepping Stone Toward Necessary Change: How the New USMLE Step 1 Scoring System Could Affect the Residency Application Process. Acad Med. 2020;95(9):1312-1314. doi:10.1097/ACM.0000000000003501
Gliatto P, Leitman IM, Muller D. Scylla and Charybdis: The MCAT, USMLE, and Degrees of Freedom in Undergraduate Medical Education. Acad Med. 2016;91(11):1498-1500. doi:10.1097/ACM.0000000000001247
Rubright JD, Jodoin M, Barone MA. Examining Demographics, Prior Academic Performance, and United States Medical Licensing Examination Scores. Acad Med. 2019;94(3):364-370. doi:10.1097/ACM.0000000000002366
Wusu MH, Tepperberg S, Weinberg JM, Saper RB. Matching Our Mission: A Strategic Plan to Create a Diverse Family Medicine Residency. Fam Med. 2019;51(1):31-36. doi:10.22454/FamMed.2019.955445
Boylan M, Grant RE. Diversity and professional excellence. J Natl Med Assoc. 2004;96(10):1354-1362.
Garrick JF, Perez B, Anaebere TC, Craine P, Lyons C, Lee T. The Diversity Snowball Effect: The Quest to Increase Diversity in Emergency Medicine: A Case Study of Highland's Emergency Medicine Residency Program. Ann Emerg Med. 2019;73(6):639-647. doi:10.1016/j.annemergmed.2019.01.039
Jones RP. The Hidden Roots of White Supremacy: And the Path to a Shared American Future. First Simon & Schuster hardcover edition. Simon & Schuster; 2023.
Kendi IX. How to Be an Antiracist. One World; 2019.
Came H, Griffith D. Tackling racism as a "wicked" public health problem: Enabling allies in anti-racism praxis. Soc Sci Med. 2018;199:181-188. doi:10.1016/j.socscimed.2017.03.028
Butler PD, Fowler JC, Meer E, Rosen IM, Reyes IM, Berns JS. A Blueprint for Increasing Ethnic and Racial Diversity in U.S. Residency Training Programs. Acad Med. 2022;97(11):1632-1636. doi:10.1097/ACM.0000000000004847
Ludmerer KM. Let Me Heal: The Opportunity to Preserve Excellence in American Medicine. Oxford University Press; 2015. Accessed May 31, 2024. http://site.ebrary.com/id/10901481
Arksey H, O'Malley L. Scoping studies: towards a methodological framework. International journal of social research methodology. 2005;8(1):19-32. doi:10.1080/1364557032000119616 [Page 21].
Tricco AC, Lillie E, Zarin W, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467-473. doi:10.7326/M18-0850.
Aromataris E, Munn Z, Eds. JBI Manual for Evidence Synthesis. JBI, 2020. Available from https://synthesismanual.jbi.global. https://doi.org/10.46658/JBIMES-20-01 Accessed 4 January 2022.
Love JN, Ronan-Bentle SE, Lane DR, Hegarty CB. The Standardized Letter of Evaluation for Postgraduate Training: A Concept Whose Time Has Come? Acad Med. 2016;91(11):1480-1482. doi:10.1097/ACM.0000000000001352
McDade WA. 2019. Op Cit.
McGowan J, Straus S, Moher D, et al. Reporting scoping reviews-PRISMA ScR extension. J Clin Epidemiol. 2020;123:177-179. doi:10.1016/j.jclinepi.2020.03.016
Equator Network. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Available from: < https://www.equator-network.org/reporting-guidelines/prisma-scr/ >. Accessed 30 August 2024.
McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement. J Clin Epidemiol. 2016;75:40-46. doi:10.1016/j.jclinepi.2016.01.021
Thomas CL. African Americans and women in orthopaedic residency. The Johns Hopkins experience. Clin Orthop Relat Res. 1999;(362):65-71.
Bird SB, Hern HG, Blomkalns A, Deiorio NM, Haywood Y, Hiller KM, Dunleavy D, Dowd K. Innovation in Residency Selection: The AAMC Standardized Video Interview. Acad Med. 2019 Oct;94(10):1489-1497. doi: 10.1097/ACM.0000000000002705. PMID: 30870151.
Spector AR, Railey KM. Reducing Reliance on Test Scores Reduces Racial Bias in Neurology Residency Recruitment. J Natl Med Assoc. 2019 Oct;111(5):471-474. doi: 10.1016/j.jnma.2019.03.004. Epub 2019 Mar 29.
Villwock JA, Hamill CS, Sale KA, Sykes KJ. Beyond the USMLE: The STAR Algorithm for Initial Residency Applicant Screening and Interview Selection. J Surg Res. 2019 Mar;235:447-452. doi: 10.1016/j.jss.2018.07.057.
Bell RM, Fann SA, Morrison JE, Lisk JR. Determining personal talents and behavioral styles of applicants to surgical training: a new look at an old problem, part I. J Surg Educ. 2011;68(6):534-541. doi:10.1016/j.jsurg.2011.05.016
Bowe SN, Weitzel EK, Hannah WN Jr, et al. Introducing a Novel Applicant Ranking Tool to Predict Future Resident Performance: A Pilot Study. Mil Med. 2017;182(1):e1514-e1520. doi:10.7205/MILMED-D-15-00436
Hemaida RS, Kalb E. Using the analytic hierarchy process for the selection of first-year family practice residents. Hosp Top. 2001;79(1):11-15. doi:10.1080/00185860109597894
Forman EH, Gass SI. The analytic hierarchy process—an exposition. Operations research. 2001;49(4):469-486. doi:10.1287/opre.49.4.469.11231
McGuire KJ, Sparks MB, Gitajn IL, et al. Selecting Residents for Predetermined Factors Identified and Thought to be Important for Work Performance and Satisfaction: A Methodology. J Surg Educ. 2019;76(4):949-961. doi:10.1016/j.jsurg.2019.02.004
Quintero AJ, Segal LS, King TS, Black KP. The personal interview: assessing the potential for personality similarity to bias the selection of orthopaedic residents. Acad Med. 2009;84(10):1364-1372. doi:10.1097/ACM.0b013e3181b6a9af
Zardouz S, German MA, Wu EC, Djalilian HR. Personality types of otolaryngology resident applicants as described by the Myers-Briggs Type Indicator. Otolaryngol Head Neck Surg. 2011;144(5):714-718. doi:10.1177/0194599810397793
Boyd R, Brown T. Pilot study of Myers Briggs Type Indicator personality profiling in emergency department senior medical staff. Emerg Med Australas. 2005;17(3):200-203. doi:10.1111/j.1742-6723.2005.00723.x. PMID: 15953219.
Hojat M, Nasca TJ, Magee M, et al. A comparison of the personality profiles of internal medicine residents, physician role models, and the general population. Acad Med. 1999;74(12):1327-1333. doi:10.1097/00001888-199912000-00017
Schnapp BH, Ritter D, Kraut AS, Fallon S, Westergaard MC. Assessing Residency Applicants' Communication and Professionalism: Standardized Video Interview Scores Compared to Faculty Gestalt. West J Emerg Med. 2019;20(1):132-137. doi:10.5811/westjem.2018.10.39709.
Shebrain S, Arafeh M, Munene G, et al. The role of academic achievements and psychometric measures in the ranking process. Am J Surg. 2019;217(3):568-571. doi:10.1016/j.amjsurg.2018.09.015
Stephenson-Famy A, Houmard BS, Oberoi S, Manyak A, Chiang S, Kim S. Use of the Interview in Resident Candidate Selection: A Review of the Literature. J Grad Med Educ. 2015;7(4):539-548. doi:10.4300/JGME-D-14-00236.1
Thomas CL. 1999 op. cit.
Butler PD, Aarons CB, Ahn J, et al. Leading From the Front: An Approach to Increasing Racial and Ethnic Diversity in Surgical Training Programs. Ann Surg. 2019;269(6):1012-1015. doi:10.1097/SLA.0000000000003197
Wusu MH, Tepperberg S, Weinberg JM, Saper RB. Matching Our Mission: A Strategic Plan to Create a Diverse Family Medicine Residency. Fam Med. 2019;51(1):31-36. doi:10.22454/FamMed.2019.955445
Schenker ML, Baldwin KD, Israelite CL, Levin LS, Mehta S, Ahn J. Selecting the Best and Brightest: A Structured Approach to Orthopedic Resident Selection. J Surg Educ. 2016 Sep-Oct;73(5):879-85. doi: 10.1016/j.jsurg.2016.04.004. Epub 2016 May 24. PMID: 27230568.
Martin M, Salzberg L. Resident characteristics to evaluate during recruitment and interview: a Delphi study. Educ Prim Care. 2017 Mar;28(2):81-85. doi: 10.1080/14739879.2016.1266696.
Martin M, Salzberg L. Ibid.
Aibana O, Swails JL, Flores RJ, Love L. Bridging the Gap: Holistic Review to Increase Diversity in Graduate Medical Education. Acad Med. 2019;94(8):1137-1141. doi:10.1097/ACM.0000000000002779
Garrick JF, Perez B, Anaebere TC, Craine P, Lyons C, Lee T. The Diversity Snowball Effect: The Quest to Increase Diversity in Emergency Medicine: A Case Study of Highland's Emergency Medicine Residency Program. Ann Emerg Med. 2019;73(6):639-647. doi:10.1016/j.annemergmed.2019.01.039
Spottswood SE, Spalluto LB, Washington ER, et al. Design, Implementation, and Evaluation of a Diversity Program for Radiology. J Am Coll Radiol. 2019;16(7):983-991. doi:10.1016/j.jacr.2018.12.00
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Dr. Dunivan, Jon, Dr. Ballejos, Dr. Gonzales, Vice President Romero-Leggott
This work is licensed under a Creative Commons Attribution 4.0 International License.
