Evaluating the impact of pass/fail United States Medical Licensing Examination Step 1 scoring on pathology residency selection

Beginning 26 January 2022, the United States Medical Licensing Examination Step 1 changed from a numerical score to Pass/Fail. Historically, residency programs have used Step 1 scores as a valuable metric in assessing the competitiveness of applicants. We assessed how residency program criteria will change when evaluating applicants after Step 1 becomes Pass/Fail. A survey was distributed to the program directors of all 144 pathology residency programs accredited by Accreditation Council for Graduate Medical Education. Survey questions evaluated the importance of using Step 1 and Step 2 Clinical Knowledge (CK) scores when assessing applicants. Participants were asked to rank a list of applicant criteria used before and after Step 1 becomes Pass/Fail. Data were analyzed using chi-squared and paired t-tests with significance at P < 0.05. A total of 34 residency program directors (23.6%) responded to the survey. 76.5% (P< 0.001) of responders believed Step 1 scores were able to predict a resident's ability to pass their board exams, while 41.2% believed Step 2 CK could predict a resident's ability to pass board exams and perform clinically in pathology (P = 0.282). 61.8% of responders agreed that an applicant's medical school ranking would become more important (P = 0.001). There were no significant differences in the relative importance of 16 selection criteria after the change of Step 1 to Pass/Fail. It does not appear that Step 2 CK will become more important. Although results are constrained by a 23.6% response rate, it can be a start to guiding future students through residency applications.