Development of Clinical Skills and Confidence Questionnaire for Triage and Action Minor Emergency Course: Test-Retest Exam

Aim: The Triage and Action (T&A) minor emergency course was developed to improve the clinical skills of Japanese non-specialist physicians for minor emergent problems. Currently, the course quality is evaluated only by a self-reported satisfaction questionnaire. This study described a new clinical skills and confidence questionnaire to evaluate its validity and reliability. Methods: The web-based questionnaire was evaluated by 103 physicians identified from a mailing list as having taken the T&A minor emergency course. The clinical experience and confidence (CEC) questionnaire was prepared, and its content and contextual validity were validated using a clinical sensibility test (CST). Reliability was assessed by the interclass correlation coefficient after two weeks via a follow-up CEC questionnaire. Results: Of the 103 physicians contacted 44 (42.7%) responded to the questionnaire, 36 (40.8%) to the follow-up CEC questionnaire, and 33 (32.0%) to both questionnaires; 28 (27.2%) participants took the clinical sensibility test. Five questions which asked the total number of patients treated within six months showed fair agreement on the reliability test. All answers to the questions in the CST were favorable. Conclusion: We removed every question which asked the total number of patients treated for various minor emergencies within six months from CEC. Consequently, the new questionnaire was shown to be contextually well validated and reliable. We will use the CEC questionnaire to improve our course, which we hope to demonstrate improved primary care for selected minor conditions.