Medical Student Assessment in the Time of COVID-19

BACKGROUND: Medical student education in the era of the COVID-19 outbreak is vastly different than the standard education we have become accustomed to. Medical student assessment is an important aspect of adjusting curriculums in the era of increased virtual learning. METHODS: Students took our previously validated free response clinical skills exam (CSE) at the end of the scheduled clerkship as an open-book exam to eliminate any concern for breaches in the honor code and then grades were adjusted based on historic norms. The National Board of Medical Examiners (NBME) shelf exam was taken with a virtual proctor. Students whose clerkship was affected by the COVID-19 pandemic were compared to the students from a similarly timed surgery block the previous 3 years. Primary outcomes included CSE and NBME exam scores. Secondary outcomes included clinical evaluations and the percentage of students who received grades of Honors, High Pass, and Pass. After the surgery clerkship was completed, we surveyed all students who participated in the surgery clerkship during the COVID-19 crisis. RESULTS: There were 19 students during the COVID-interrupted clerkship and 61 students in similarly timed clerkships between 2017 and 2019. Prior to adjustment and compared to historic scores, the COVID-interrupted clerkship group scored higher on the CSE, NBME exam, and performance evaluations (median, CSE:75.2 vs 68.7, shelf:68.0 vs 64.0, performance evaluation mean: 2.96 vs 2.78). The percentage of students with an honors was marginally higher in the group affected by COVID (42% vs 32%). Out of 19 students surveyed, 9 students responded. Seven students stated they would have preferred a closed-book CSE, citing a few drawbacks of the open-book format such as modifying their exam preparation, being discouraged from thinking prior to searching online during the test, and second guessing their answers. CONCLUSIONS: During the initial outbreak of COVID-19, we found that an open book exam and a virtually proctored shelf exam was a reasonable option. However, to avoid adjustments and student dissatisfaction, we would recommend virtual proctoring if available.