Exploring completeness in clinical data research networks with DQ(e)-c

OBJECTIVE: To provide an open source, interoperable, and scalable data quality assessment tool for evaluation and visualization of completeness and conformance in electronic health record (EHR) data repositories. MATERIALS AND METHODS: This article describes the tool’s design and architecture and gives an overview of its outputs using a sample dataset of 200 000 randomly selected patient records with an encounter since January 1, 2010, extracted from the Research Patient Data Registry (RPDR) at Partners HealthCare. All the code and instructions to run the tool and interpret its results are provided in the Supplementary Appendix. RESULTS: DQ(e)-c produces a web-based report that summarizes data completeness and conformance in a given EHR data repository through descriptive graphics and tables. Results from running the tool on the sample RPDR data are organized into 4 sections: load and test details, completeness test, data model conformance test, and test of missingness in key clinical indicators. DISCUSSION: Open science, interoperability across major clinical informatics platforms, and scalability to large databases are key design considerations for DQ(e)-c. Iterative implementation of the tool across different institutions directed us to improve the scalability and interoperability of the tool and find ways to facilitate local setup. CONCLUSION: EHR data quality assessment has been hampered by implementation of ad hoc processes. The architecture and implementation of DQ(e)-c offer valuable insights for developing reproducible and scalable data science tools to assess, manage, and process data in clinical data repositories.