Determining the Hospital Information System (HIS) Success Rate: Development of a New Instrument and Case Study

BACKGROUND: Hospital Information System (HIS) is a type of health information system which is widely used in clinical settings. Determining the success rate of HISs is an ongoing area of research since its implications are of interest for researchers, physicians and managers. AIM: In the present study, we develop a novel instrument to measure HIS success rate based on users’ viewpoints in a teaching hospital. METHODS: The study was conducted in Ebnesina and Dr Hejazi Psychiatric Hospital and education centre in Mashhad, Iran. The instrument for data collection was a self-administered structured questionnaire based on ISSM, covering seven dimensions, which includes system quality, information quality, service quality, system use, usefulness, satisfaction, and net benefits. The verification of content validity was carried out by an expert panel. The internal consistency of dimensions was measured by Cronbach’s alpha. Pearson’s correlation coefficient was calculated to evaluate the significance of associations between dimensions. The HIS success rate on users’ viewpoints was determined. RESULTS: A total of 125 users participated in the study. The instrument was validated by an expert panel with the Content Validity Index (CVI): 0.85 and Content Validity Ratio (CVR): 0.86. The overall Cronbach’s alpha value of the instrument was 0.93. The Pearson correlation coefficient showed significant positive relationships among the investigated dimensions. On average, HIS success rate in the hospital under study was 65% (CI: 64%, 67%). The dimensions of “usefulness”, “system quality”, and “net benefits” showed the highest rates of success, respectively. CONCLUSION: The instrument used in this study can be adopted for HIS evaluation in future studies. In the current study, a method was developed to determine the HIS success rate based on users’ viewpoints. This method allows for the comparison of HIS success rates in various hospitals. As well, our findings underscore the viewpoints of HIS users in a developing country.’