Development and validation a task-specific checklist for a microsurgical varicocelectomy simulation model

PURPOSE: To develop and validate a new test of specific technical skills required for microsurgical varicocelectomy. MATERIALS AND METHODS: An electronic questionnaire was sent to 558 members of the Brazilian Society of Urology for the validation of the task-specific checklist (TSC) for assessment of microsurgical varicocelectomy. Participants who had experience in this procedure were selected as judges. For construct validation, 12 participants including attending urologists and urological residents in training were recruited for voluntary participation. We formed a group of three experts and a group of nine novices, who had to perform the steps of microsurgical varicocelectomy on a simulation model using human placenta. Each participant was filmed and two blinded raters would then evaluate their performance using the TSC of microsurgical varicocelectomy. RESULTS: 14 judges were recruited. The assessment tool was reformulated, according to the judges suggestions and had the content validity achieved. The final version of the TSC was comprised of the task-specific score, a series of 4 items scored in a binary fashion designed for microscopic sub-inguinal varicocelectomy. The differences between the performance of participants with different levels of experience reflected the construct validity. The reliability between the raters was high. The mean time required to complete the training of microsurgical varicocelectomy in simulation model was significantly shorter for experts compared to novices (201 vs. 496 seconds, p=0.01). CONCLUSIONS: This preliminary study suggests that the task-specific checklist of microsurgical varicocelectomy is reliable and valid in assessing microsurgical skills.