A WeChat applet-based national remote emergency system for malignant hyperthermia in China: a usability study

BACKGROUND: Malignant hyperthermia (MH) is a rare anesthetic emergency with a high mortality rate in China. We developed a WeChat applet–based National Remote Emergency System for Malignant Hyperthermia (MH-NRES) to provide a real-time emergency system to help Chinese anesthesiologists deal with MH crises. However, it is imperative that close attention should be paid to the usability of the applet. PURPOSE: The objectives of this study were to (1) evaluate the usability of the applet-based MH-NRES for anesthesiologists; and (2) to test the validity and reliability of a modified mHealth app usability questionnaire. METHODS: A modified User Version of the Mobile Application Rating Scale (uMARS) was designed. Together with System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ), another two well-validated questionnaires, uMARS were then used to evaluate the usability of MH-NRES. The Cronbach alpha of the total score and the subscales of uMARS was calculated to evaluate the internal consistency. The correlation coefficients among three questionnaires were calculated. RESULTS: In this study, 118 anesthesiologists provided responses to the questionnaire. The overall mean uMARS score was 4.43 ± 0.61, which ranged from 3 to 5. The mean PSSUQ score were in good to excellent range with mean of 6.02 ± 0.97, which ranged from 3.19 to 7. The overall SUS score was 76.0 ± 17.6, which ranged from 45 to 100. The total uMARS score had excellent internal consistency (Cronbach alpha = 0.984). uMARS and its subscales were strongly correlated with PSSUQ (coefficient 0.758–0.819, P < 0.001) and SUS (coefficient 0.535–0.561, P < 0.001), respectively. CONCLUSIONS: Data obtained from the usability evaluation questionnaires in this study indicated a high quality of the MH-NRES on the ease of use, satisfaction and perceived usefulness, which suggest this system might be a useful tool for anesthesiologists’ education and management of MH crises. Future feedback from high-fidelity simulation and clinical scenarios are need for further usability evaluation of this system. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12911-023-02275-4.