Script Concordance Tests for Formative Clinical Reasoning and Problem-Solving Assessment in General Pediatrics

INTRODUCTION: Script Concordance Tests (SCTs) are short clinical vignettes with proposed diagnoses, diagnostic studies, treatments, and management options for patient care scenarios. The SCTs included in this resource were incorporated into a required pediatric clerkship to facilitate formative student feedback and additional opportunities for precepting faculty to provide midclerkship feedback. Pediatric cases were specifically selected due to the scarcity of medical student experience with common pediatric clinical presentations. METHODS: We developed eight themed SCTs comprising 72 individual test items focused on common topics in general pediatrics. Items were administered to a convenience sample of third-year medical students during their required pediatric clerkship between fall 2016 and spring 2020. To evaluate the SCTs, we conducted item analyses, as well as comparing student performance to summative assessments. RESULTS: The mean aggregate percentage score across all SCTs was .84 (SD = .08). Student SCT performance was related to USMLE Step 2 Clinical Knowledge scores, clerkship grades, and NBME Pediatrics Shelf Exam scores. DISCUSSION: These SCTs facilitated feedback to medical students in the clinical learning environment. Their current form provides a means of exploring student clinical reasoning and problem-solving and can be used at a single point or to measure longitudinally. When paired with structured subject- and competency-specific midclerkship student evaluation, SCTs helped facilitate timely feedback to students via immediate explanations of each question. SCTs can assist students in recognizing and reflecting on potential knowledge gaps.