The impact of a computerized physician order entry system implementation on 20 different criteria of medication documentation—a before-and-after study

BACKGROUND: The medication process is complex and error-prone. To avoid medication errors, a medication order should fulfil certain criteria, such as good readability and comprehensiveness. In this context, a computerized physician order entry (CPOE) system can be helpful. This study aims to investigate the distinct effects on the quality of prescription documentation of a CPOE system implemented on general wards in a large tertiary care hospital. METHODS: In a retrospective analysis, the prescriptions of two groups of 160 patients each were evaluated, with data collected before and after the introduction of a CPOE system. According to nationally available recommendations on prescription documentation, it was assessed whether each prescription fulfilled the established 20 criteria for a safe, complete, and actionable prescription. The resulting fulfilment scores (prescription-Fscores) were compared between the pre-implementation and the post-implementation group and a multivariable analysis was performed to identify the effects of further covariates, i.e., the prescription category, the ward, and the number of concurrently prescribed drugs. Additionally, the fulfilment of the 20 criteria was assessed at an individual criterion-level (denoted criteria-Fscores). RESULTS: The overall mean prescription-Fscore increased from 57.4% ± 12.0% (n = 1850 prescriptions) before to 89.8% ± 7.2% (n = 1592 prescriptions) after the implementation (p < 0.001). At the level of individual criteria, criteria-Fscores significantly improved in most criteria (n = 14), with 6 criteria reaching a total score of 100% after CPOE implementation. Four criteria showed no statistically significant difference and in two criteria, criteria-Fscores deteriorated significantly. A multivariable analysis confirmed the large impact of the CPOE implementation on prescription-Fscores which was consistent when adjusting for the confounding potential of further covariates. CONCLUSIONS: While the quality of prescription documentation generally increases with implementation of a CPOE system, certain criteria are difficult to fulfil even with the help of a CPOE system. This highlights the need to accompany a CPOE implementation with a thorough evaluation that can provide important information on possible improvements of the software, training needs of prescribers, or the necessity of modifying the underlying clinical processes. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12911-021-01607-6.