Development of an Evaluation Framework for Health Information Systems (DIPSA)

INTRODUCTION: Use of Integrated Health Information Systems (IHIS) for the provision of healthcare services benefits both healthcare professionals and patients, while requiring continuous evaluation and upgrading to fully support its role. AIM: The main purpose of the study was to develop an evaluation framework for hospitals utilizing IHIS, within the three main areas identified as Human factor, Technology and Organization. MATERIAL AND METHODS: The questionnaire consisted of 43 questions, with 17 questions (related to categories procedures, system quality and satisfaction), 25 questions (related to categories, safety and collaboration) and 1 question related to accessibility to the system (within the category system quality). Three open questions were added to evaluate users’ perception on what was needed for the improvement of health services in their respective hospitals for all 3 variables being evaluated. The open questions were included to allow participants to express their opinion in a more detailed setting. A database was developed, and the data were processed and analyzed. RESULTS: Factor analysis formed 5 categories for the evaluation framework. Cronbach’s alpha coefficient was found in all categories to be above > 0.85. CONCLUSION: Evaluation frameworks can be designed, developed and implemented by using different methodologies. For an evaluation framework to be effective it should be designed and implemented based on the aims and purpose of the research and the specific needs of the particular healthcare setting or hospital. Considering the categories satisfaction, collaboration, safety, system quality, procedures, and by using Likert scale and open questions in the current study, DIPSA can provide a holistic image of IHIS by evaluating any hospital system.