Usability Evaluation of Three Admission and Medical Records Subsystems Integrated into Nationwide Hospital Information Systems: Heuristic Evaluation

INTRODUCTION: Usability is one of the quality criteria for information systems and its weakness is one of the main barriers to the adoption of these systems. The purpose of this study was to evaluate the usability of admission and medical records module of three widely used hospital information systems (HISs). METHODS: In this descriptive study the usability of admission and medical records module of three HISs (HIS1, HIS2, and HIS3) was evaluated using heuristic evaluation method. For each HIS, three expert users of the same system assessed the user interface independently, completed a usability evaluation checklist, and rated severity of each identified problem. The checklist was based on Nielsen’s heuristics. For each HIS, three heuristics that have the highest and lowest problem rates and greatest severity of problems were categorized into three separate groups. The results were analyzed using descriptive statistics. RESULTS: Although HIS1 and HIS2 were used in more hospitals than HIS3, the results showed that the usability problem rates of them were significantly higher than HIS3. The heuristics of “help and documentation”, “flexibility and efficiency of use”, and “visibility of system status” in the three HISs were categorized into the “highest rate of problems”, “lowest rate of problems”, and “highest severity of problems” groups, respectively. The heuristics of “diagnose and recover from errors”, “error prevention”, and “help and documentation” in HIS1 and HIS2 were categorized into the “highest rate of problems” group. CONCLUSIONS: The results of this study and previous studies show that the most common usability problems with HISs are related to heuristics of “help and documentation”, “error prevention”, and “help users recognize, diagnose and recover from errors.” Also, the large number of hospitals using one HIS does not demonstrate its high usability to others.