Cargando…
Overcoming challenges to data quality in the ASPREE clinical trial
BACKGROUND: Large-scale studies risk generating inaccurate and missing data due to the complexity of data collection. Technology has the potential to improve data quality by providing operational support to data collectors. However, this potential is under-explored in community-based trials. The Asp...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6902598/ https://www.ncbi.nlm.nih.gov/pubmed/31815652 http://dx.doi.org/10.1186/s13063-019-3789-2 |
_version_ | 1783477704994062336 |
---|---|
author | Lockery, Jessica E. Collyer, Taya A. Reid, Christopher M. Ernst, Michael E. Gilbertson, David Hay, Nino Kirpach, Brenda McNeil, John J. Nelson, Mark R. Orchard, Suzanne G. Pruksawongsin, Kunnapoj Shah, Raj C. Wolfe, Rory Woods, Robyn L. |
author_facet | Lockery, Jessica E. Collyer, Taya A. Reid, Christopher M. Ernst, Michael E. Gilbertson, David Hay, Nino Kirpach, Brenda McNeil, John J. Nelson, Mark R. Orchard, Suzanne G. Pruksawongsin, Kunnapoj Shah, Raj C. Wolfe, Rory Woods, Robyn L. |
author_sort | Lockery, Jessica E. |
collection | PubMed |
description | BACKGROUND: Large-scale studies risk generating inaccurate and missing data due to the complexity of data collection. Technology has the potential to improve data quality by providing operational support to data collectors. However, this potential is under-explored in community-based trials. The Aspirin in reducing events in the elderly (ASPREE) trial developed a data suite that was specifically designed to support data collectors: the ASPREE Web Accessible Relational Database (AWARD). This paper describes AWARD and the impact of system design on data quality. METHODS: AWARD’s operational requirements, conceptual design, key challenges and design solutions for data quality are presented. Impact of design features is assessed through comparison of baseline data collected prior to implementation of key functionality (n = 1000) with data collected post implementation (n = 18,114). Overall data quality is assessed according to data category. RESULTS: At baseline, implementation of user-driven functionality reduced staff error (from 0.3% to 0.01%), out-of-range data entry (from 0.14% to 0.04%) and protocol deviations (from 0.4% to 0.08%). In the longitudinal data set, which contained more than 39 million data values collected within AWARD, 96.6% of data values were entered within specified query range or found to be accurate upon querying. The remaining data were missing (3.4%). Participant non-attendance at scheduled study activity was the most common cause of missing data. Costs associated with cleaning data in ASPREE were lower than expected compared with reports from other trials. CONCLUSIONS: Clinical trials undertake complex operational activity in order to collect data, but technology rarely provides sufficient support. We find the AWARD suite provides proof of principle that designing technology to support data collectors can mitigate known causes of poor data quality and produce higher-quality data. Health information technology (IT) products that support the conduct of scheduled activity in addition to traditional data entry will enhance community-based clinical trials. A standardised framework for reporting data quality would aid comparisons across clinical trials. TRIAL REGISTRATION: International Standard Randomized Controlled Trial Number Register, ISRCTN83772183. Registered on 3 March 2005. |
format | Online Article Text |
id | pubmed-6902598 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-69025982019-12-11 Overcoming challenges to data quality in the ASPREE clinical trial Lockery, Jessica E. Collyer, Taya A. Reid, Christopher M. Ernst, Michael E. Gilbertson, David Hay, Nino Kirpach, Brenda McNeil, John J. Nelson, Mark R. Orchard, Suzanne G. Pruksawongsin, Kunnapoj Shah, Raj C. Wolfe, Rory Woods, Robyn L. Trials Methodology BACKGROUND: Large-scale studies risk generating inaccurate and missing data due to the complexity of data collection. Technology has the potential to improve data quality by providing operational support to data collectors. However, this potential is under-explored in community-based trials. The Aspirin in reducing events in the elderly (ASPREE) trial developed a data suite that was specifically designed to support data collectors: the ASPREE Web Accessible Relational Database (AWARD). This paper describes AWARD and the impact of system design on data quality. METHODS: AWARD’s operational requirements, conceptual design, key challenges and design solutions for data quality are presented. Impact of design features is assessed through comparison of baseline data collected prior to implementation of key functionality (n = 1000) with data collected post implementation (n = 18,114). Overall data quality is assessed according to data category. RESULTS: At baseline, implementation of user-driven functionality reduced staff error (from 0.3% to 0.01%), out-of-range data entry (from 0.14% to 0.04%) and protocol deviations (from 0.4% to 0.08%). In the longitudinal data set, which contained more than 39 million data values collected within AWARD, 96.6% of data values were entered within specified query range or found to be accurate upon querying. The remaining data were missing (3.4%). Participant non-attendance at scheduled study activity was the most common cause of missing data. Costs associated with cleaning data in ASPREE were lower than expected compared with reports from other trials. CONCLUSIONS: Clinical trials undertake complex operational activity in order to collect data, but technology rarely provides sufficient support. We find the AWARD suite provides proof of principle that designing technology to support data collectors can mitigate known causes of poor data quality and produce higher-quality data. Health information technology (IT) products that support the conduct of scheduled activity in addition to traditional data entry will enhance community-based clinical trials. A standardised framework for reporting data quality would aid comparisons across clinical trials. TRIAL REGISTRATION: International Standard Randomized Controlled Trial Number Register, ISRCTN83772183. Registered on 3 March 2005. BioMed Central 2019-12-09 /pmc/articles/PMC6902598/ /pubmed/31815652 http://dx.doi.org/10.1186/s13063-019-3789-2 Text en © The Author(s). 2019 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated. |
spellingShingle | Methodology Lockery, Jessica E. Collyer, Taya A. Reid, Christopher M. Ernst, Michael E. Gilbertson, David Hay, Nino Kirpach, Brenda McNeil, John J. Nelson, Mark R. Orchard, Suzanne G. Pruksawongsin, Kunnapoj Shah, Raj C. Wolfe, Rory Woods, Robyn L. Overcoming challenges to data quality in the ASPREE clinical trial |
title | Overcoming challenges to data quality in the ASPREE clinical trial |
title_full | Overcoming challenges to data quality in the ASPREE clinical trial |
title_fullStr | Overcoming challenges to data quality in the ASPREE clinical trial |
title_full_unstemmed | Overcoming challenges to data quality in the ASPREE clinical trial |
title_short | Overcoming challenges to data quality in the ASPREE clinical trial |
title_sort | overcoming challenges to data quality in the aspree clinical trial |
topic | Methodology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6902598/ https://www.ncbi.nlm.nih.gov/pubmed/31815652 http://dx.doi.org/10.1186/s13063-019-3789-2 |
work_keys_str_mv | AT lockeryjessicae overcomingchallengestodataqualityintheaspreeclinicaltrial AT collyertayaa overcomingchallengestodataqualityintheaspreeclinicaltrial AT reidchristopherm overcomingchallengestodataqualityintheaspreeclinicaltrial AT ernstmichaele overcomingchallengestodataqualityintheaspreeclinicaltrial AT gilbertsondavid overcomingchallengestodataqualityintheaspreeclinicaltrial AT haynino overcomingchallengestodataqualityintheaspreeclinicaltrial AT kirpachbrenda overcomingchallengestodataqualityintheaspreeclinicaltrial AT mcneiljohnj overcomingchallengestodataqualityintheaspreeclinicaltrial AT nelsonmarkr overcomingchallengestodataqualityintheaspreeclinicaltrial AT orchardsuzanneg overcomingchallengestodataqualityintheaspreeclinicaltrial AT pruksawongsinkunnapoj overcomingchallengestodataqualityintheaspreeclinicaltrial AT shahrajc overcomingchallengestodataqualityintheaspreeclinicaltrial AT wolferory overcomingchallengestodataqualityintheaspreeclinicaltrial AT woodsrobynl overcomingchallengestodataqualityintheaspreeclinicaltrial AT overcomingchallengestodataqualityintheaspreeclinicaltrial |