Self-assessment scale for the community-based and emergency practice

BACKGROUND: For current medical education, community-based primary care for the elderly is an essential topic. This study aimed to establish a scale of community-based assessment for clinical and emergency practice (C-CEP). METHODS: A self-assessment scale for C-CEP was developed according to four steps. Initially, we reviewed publications from the societies of the United States, British, and Japan regarding educational goals. In addition, we searched MEDLINE for educational goals regarding attitude, skills, and knowledge. Getting together, we established 23 items as the educational goals of the C-CEP. Second, we collected responses for these 23 items from 5th-grade medical students (n = 195). Third, we conducted an exploratory factor analysis (EFA) using their responses to determine the fundamental structure of the self-assessment scale. Finally, a confirmatory factor analysis (CFA) was performed to assess the fitness of the self-assessment scale developing the EFA, resulting in modification of the items. RESULTS: In EFA and CFA results, C-CEP Scale consisted of four factors with 15 items: “Attitude and communication in emergency care,” Basic clinical skills,” “Knowledge of community healthcare,“ and “Knowledge of evidence-based medicine perseverance.” The model fit indices were acceptable (Goodness of Fix Index = 0.928, Adjusted Goodness of Fit Index = 0.900, Comparative Fit Index = 0.979, and Root Mean Square Error of Approximation = 0.045). The values of McDonald’s omega as an estimate of scale reliability were more than 0.7 in all four factors. As for test-retest reliability, the intraclass correlation coefficients were ≥ 0.58 for all factors. All four factors of the C-CEP Scale correlated positively with the Medical Professionalism Evaluation Scale subscales. CONCLUSIONS: We developed a valid and reliable self-assessment scale to assess student competence. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12909-022-03848-z.