Evaluation of User Experience of New Defense Medical Information System

OBJECTIVES: This study aimed to investigate the user experience (UX) of the New Defense Medical Information System (N-DEMIS), which was introduced in 2012 as part of an effort to improve the old system of armed forces hospitals and ultimately bring their standards up to those of civilian hospitals. METHODS: In this study, the dependent variable was the UX of N-DEMIS and was composed of usability, affect, and user value. The questionnaire comprised 41 questions: nine on general characteristics, 20 on usability, four on affect, and eight on user value. The data collection period was from April 15 to April 30, 2018. Overall, 85 responses were received; of these, three insincere responses were excluded, and the remaining 82 responses were used in the analysis. RESULTS: The overall value of Cronbach's alpha was 0.917, indicating an overall high-reliability. There was a significant difference between user value and usability, but there was no significant differences between the other pairs. We observed a significant effect on UX for length of time working in an armed forces hospital and employment type. CONCLUSIONS: The results of our survey showed an even distribution of scores across the three elements of UX, showing that no particular aspect of N-DEMIS is superior to the others in terms of user satisfaction. However, the overall UX score of around 60% indicates the need for future improvements. Rather than focusing improvements on a specific area, improvements should be spread across usability, affect, and user value.