Assessment of Surgeon Performance of Advanced Open Surgical Skills Using a Microskills-Based Novel Curriculum

IMPORTANCE: The increase in minimally invasive surgical procedures has eroded exposure of general surgery residents to open operations. High-fidelity simulation, together with deliberate instruction, is needed for advanced open surgical skill (AOSS) development. OBJECTIVE: To collect validity evidence for AOSS tools to support a shared model for instruction. DESIGN, SETTING, AND PARTICIPANTS: This prospective cohort study included postresidency surgeons (PRSs) and second-year general surgery residents (R2s) at a single academic medical center who completed simulated tasks taught within the AOSS curriculum between June 1 and October 31, 2021. EXPOSURES: The AOSS curriculum includes 6 fine-suture and needle handling tasks, including deep suture tying (with and without needles) and continuous suturing using the pitch-and-catch and push-push-pull techniques (both superficial and deep). Teaching and assessment are based on specific microskills using a 3-dimensional printed iliac fossa model. MAIN OUTCOMES AND MEASURES: The PRS group was timed and scored (5-point Likert scale) on 10 repetitions of each task. Six months after receiving instruction on the AOSS tasks, the R2 group was similarly timed and scored. RESULTS: The PRS group included 14 surgeons (11 male [79%]; 8 [57%] attending surgeons) who completed the simulation; the R2 group, 9 surgeons (5 female [55%]) who completed the simulation. Score and time variability were greater for the R2s compared with the PRSs for all tasks. The R2s scored lower and took longer on (1) deep pitch-and-catch suturing (69% of maximum points for a mean [SD] of 142.0 [31.7] seconds vs 77% for a mean [SD] of 95.9 [29.4] seconds) and deep push-push-pull suturing (63% of maximum points for a mean [SD] of 284.0 [72.9] seconds vs 85% for a mean [SD] of 141.4 [29.1] seconds) relative to the corresponding superficial tasks; (2) suture tying with a needle vs suture tying without a needle (74% of maximum points for a mean [SD] of 64.6 [19.8] seconds vs 90% for a mean [SD] of 54.4 [15.6] seconds); and (3) the deep push-push-pull vs pitch-and-catch techniques (63% of maximum points for a mean [SD] of 284.0 [72.9] seconds vs 69% of maximum points for a mean [SD] of 142.0 [31.7] seconds). For the PRS group, time was negatively associated with score for the 3 hardest tasks: superficial push-push-pull (ρ = 0.60; P = .02), deep pitch-and-catch (ρ = 0.73; P = .003), and deep push-push-pull (ρ = 0.81; P < .001). For the R2 group, time was negatively associated with score for the 2 easiest tasks: suture tying without a needle (ρ = 0.78; P = .01) and superficial pitch-and-catch (ρ = 0.79; P = .01). CONCLUSIONS AND RELEVANCE: The findings of this cohort study offer validity evidence for a novel AOSS curriculum; reveal differential difficulty of tasks that can be attributed to specific microskills; and suggest that position on the surgical learning curve may dictate the association between competency and speed. Together these findings suggest specific, actionable opportunities to guide instruction of AOSS, including which microskills to focus on, when individual rehearsal vs guided instruction is more appropriate, and when to focus on speed.