Empirical research on the utility of a preparation manual for a disaster medical response drill

PURPOSE: It is difficult for emergency physicians to plan and execute a disaster medical response drill while conducting their daily work activities. Readily available drill preparation manuals are therefore essential, alongside assessment methods to ensure quality. Here, we propose email text analysis as a manual assessment method, and investigate its validity. METHODS: The preparation status of two similar large-scale disaster medical response drills were compared. All email texts exchanged during the preparation stage were analyzed, and frequently appearing words (quality element) and word counts (quantity element) were compared between Drill 1, which was organized without a manual, and Drill 2, organized with a manual. RESULTS: Word frequency analysis revealed that the key components of the manual (visualization of necessary work, preparation of documents in a certain format, and clarification of aims of the drill) contributed to the effectiveness of the preparation process for Drill 2. Furthermore, work volume during the preparation for Drill 2 was decreased by 41.9% from that during the preparation for Drill 1. CONCLUSION: Preparation of a high-quality manual is crucial so that emergency physicians can plan and execute a disaster medical response drill. Email text analysis can serve as an objective method assessing the quality of manuals.