Harnessing power of simulation training effectiveness with Kirkpatrick model in emergency surgical airway procedures

OBJECTIVES: Training effectiveness indicates how good a program has met pre-set training objectives or organizational goals for the best benefit of healthcare professionals and service users in the community. The study aimed to evaluate training effectiveness following implementation of new training curriculum of emergency surgical airway procedures (Cricothyroidotomy) organized by the Queen Elizabeth Hospital. DESIGN: This training evaluation relied on observational descriptive study design. Timed task on Cricothyroidotomy procedures and standardized post-training questionnaire were applied to assess the first 3 levels of Kirkpatrick's model: (Level-1) Reaction by training satisfaction; (Level-2) Learning by acquisition of knowledge and skills assessment passing rate; (Level-3) Behavior by personal strengths. SETTING: This program was operated in the Multi-Disciplinary Simulation and Skills Centre, a hospital-based high-fidelity simulation training center accredited by the Society for Simulation in Healthcare. PARTICIPANTS: The study recruited 80 trauma service providers, including 35 general surgeons, 15 emergency physicians, 10 anesthesiologists or intensivists, 6 neurosurgeons, 4 orthopedic surgeons, and 10 emergency nurses from five trauma centers under the Hospital Authority. All underwent the Advanced Trauma Life Support training in advance. RESULTS: Compared with reference score from previous training sessions, the result of program using new training curriculum and simulator demonstrated significant training satisfaction of participants (Level-1), and high level of assertiveness, mental preparedness, self-efficacy, and internal locus of control and responsibility (p < .01, for all in Level-3). All participants (N = 80) completed entire Cricothyroidotomy procedure in 2 min without technical errors (Assessment passing rate = 100%) (Level-2). CONCLUSIONS: Under Kirkpatrick model, simulation training in Cricothyroidotomy procedure using new curriculum and simulators has been proven to be useful for healthcare professionals involved in trauma service management. The result suggests that application of a state-of-the-art training tools to advanced surgical skills training could improve training satisfaction, knowledge and skills acquisition, and personal strengths transferable to clinical practice. ACGME COMPETENCIES: Practice Based Learning and Improvement.