Cargando…

Overcoming challenges to data quality in the ASPREE clinical trial

BACKGROUND: Large-scale studies risk generating inaccurate and missing data due to the complexity of data collection. Technology has the potential to improve data quality by providing operational support to data collectors. However, this potential is under-explored in community-based trials. The Asp...

Descripción completa

Detalles Bibliográficos
Autores principales: Lockery, Jessica E., Collyer, Taya A., Reid, Christopher M., Ernst, Michael E., Gilbertson, David, Hay, Nino, Kirpach, Brenda, McNeil, John J., Nelson, Mark R., Orchard, Suzanne G., Pruksawongsin, Kunnapoj, Shah, Raj C., Wolfe, Rory, Woods, Robyn L.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6902598/
https://www.ncbi.nlm.nih.gov/pubmed/31815652
http://dx.doi.org/10.1186/s13063-019-3789-2
_version_ 1783477704994062336
author Lockery, Jessica E.
Collyer, Taya A.
Reid, Christopher M.
Ernst, Michael E.
Gilbertson, David
Hay, Nino
Kirpach, Brenda
McNeil, John J.
Nelson, Mark R.
Orchard, Suzanne G.
Pruksawongsin, Kunnapoj
Shah, Raj C.
Wolfe, Rory
Woods, Robyn L.
author_facet Lockery, Jessica E.
Collyer, Taya A.
Reid, Christopher M.
Ernst, Michael E.
Gilbertson, David
Hay, Nino
Kirpach, Brenda
McNeil, John J.
Nelson, Mark R.
Orchard, Suzanne G.
Pruksawongsin, Kunnapoj
Shah, Raj C.
Wolfe, Rory
Woods, Robyn L.
author_sort Lockery, Jessica E.
collection PubMed
description BACKGROUND: Large-scale studies risk generating inaccurate and missing data due to the complexity of data collection. Technology has the potential to improve data quality by providing operational support to data collectors. However, this potential is under-explored in community-based trials. The Aspirin in reducing events in the elderly (ASPREE) trial developed a data suite that was specifically designed to support data collectors: the ASPREE Web Accessible Relational Database (AWARD). This paper describes AWARD and the impact of system design on data quality. METHODS: AWARD’s operational requirements, conceptual design, key challenges and design solutions for data quality are presented. Impact of design features is assessed through comparison of baseline data collected prior to implementation of key functionality (n = 1000) with data collected post implementation (n = 18,114). Overall data quality is assessed according to data category. RESULTS: At baseline, implementation of user-driven functionality reduced staff error (from 0.3% to 0.01%), out-of-range data entry (from 0.14% to 0.04%) and protocol deviations (from 0.4% to 0.08%). In the longitudinal data set, which contained more than 39 million data values collected within AWARD, 96.6% of data values were entered within specified query range or found to be accurate upon querying. The remaining data were missing (3.4%). Participant non-attendance at scheduled study activity was the most common cause of missing data. Costs associated with cleaning data in ASPREE were lower than expected compared with reports from other trials. CONCLUSIONS: Clinical trials undertake complex operational activity in order to collect data, but technology rarely provides sufficient support. We find the AWARD suite provides proof of principle that designing technology to support data collectors can mitigate known causes of poor data quality and produce higher-quality data. Health information technology (IT) products that support the conduct of scheduled activity in addition to traditional data entry will enhance community-based clinical trials. A standardised framework for reporting data quality would aid comparisons across clinical trials. TRIAL REGISTRATION: International Standard Randomized Controlled Trial Number Register, ISRCTN83772183. Registered on 3 March 2005.
format Online
Article
Text
id pubmed-6902598
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-69025982019-12-11 Overcoming challenges to data quality in the ASPREE clinical trial Lockery, Jessica E. Collyer, Taya A. Reid, Christopher M. Ernst, Michael E. Gilbertson, David Hay, Nino Kirpach, Brenda McNeil, John J. Nelson, Mark R. Orchard, Suzanne G. Pruksawongsin, Kunnapoj Shah, Raj C. Wolfe, Rory Woods, Robyn L. Trials Methodology BACKGROUND: Large-scale studies risk generating inaccurate and missing data due to the complexity of data collection. Technology has the potential to improve data quality by providing operational support to data collectors. However, this potential is under-explored in community-based trials. The Aspirin in reducing events in the elderly (ASPREE) trial developed a data suite that was specifically designed to support data collectors: the ASPREE Web Accessible Relational Database (AWARD). This paper describes AWARD and the impact of system design on data quality. METHODS: AWARD’s operational requirements, conceptual design, key challenges and design solutions for data quality are presented. Impact of design features is assessed through comparison of baseline data collected prior to implementation of key functionality (n = 1000) with data collected post implementation (n = 18,114). Overall data quality is assessed according to data category. RESULTS: At baseline, implementation of user-driven functionality reduced staff error (from 0.3% to 0.01%), out-of-range data entry (from 0.14% to 0.04%) and protocol deviations (from 0.4% to 0.08%). In the longitudinal data set, which contained more than 39 million data values collected within AWARD, 96.6% of data values were entered within specified query range or found to be accurate upon querying. The remaining data were missing (3.4%). Participant non-attendance at scheduled study activity was the most common cause of missing data. Costs associated with cleaning data in ASPREE were lower than expected compared with reports from other trials. CONCLUSIONS: Clinical trials undertake complex operational activity in order to collect data, but technology rarely provides sufficient support. We find the AWARD suite provides proof of principle that designing technology to support data collectors can mitigate known causes of poor data quality and produce higher-quality data. Health information technology (IT) products that support the conduct of scheduled activity in addition to traditional data entry will enhance community-based clinical trials. A standardised framework for reporting data quality would aid comparisons across clinical trials. TRIAL REGISTRATION: International Standard Randomized Controlled Trial Number Register, ISRCTN83772183. Registered on 3 March 2005. BioMed Central 2019-12-09 /pmc/articles/PMC6902598/ /pubmed/31815652 http://dx.doi.org/10.1186/s13063-019-3789-2 Text en © The Author(s). 2019 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
spellingShingle Methodology
Lockery, Jessica E.
Collyer, Taya A.
Reid, Christopher M.
Ernst, Michael E.
Gilbertson, David
Hay, Nino
Kirpach, Brenda
McNeil, John J.
Nelson, Mark R.
Orchard, Suzanne G.
Pruksawongsin, Kunnapoj
Shah, Raj C.
Wolfe, Rory
Woods, Robyn L.
Overcoming challenges to data quality in the ASPREE clinical trial
title Overcoming challenges to data quality in the ASPREE clinical trial
title_full Overcoming challenges to data quality in the ASPREE clinical trial
title_fullStr Overcoming challenges to data quality in the ASPREE clinical trial
title_full_unstemmed Overcoming challenges to data quality in the ASPREE clinical trial
title_short Overcoming challenges to data quality in the ASPREE clinical trial
title_sort overcoming challenges to data quality in the aspree clinical trial
topic Methodology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6902598/
https://www.ncbi.nlm.nih.gov/pubmed/31815652
http://dx.doi.org/10.1186/s13063-019-3789-2
work_keys_str_mv AT lockeryjessicae overcomingchallengestodataqualityintheaspreeclinicaltrial
AT collyertayaa overcomingchallengestodataqualityintheaspreeclinicaltrial
AT reidchristopherm overcomingchallengestodataqualityintheaspreeclinicaltrial
AT ernstmichaele overcomingchallengestodataqualityintheaspreeclinicaltrial
AT gilbertsondavid overcomingchallengestodataqualityintheaspreeclinicaltrial
AT haynino overcomingchallengestodataqualityintheaspreeclinicaltrial
AT kirpachbrenda overcomingchallengestodataqualityintheaspreeclinicaltrial
AT mcneiljohnj overcomingchallengestodataqualityintheaspreeclinicaltrial
AT nelsonmarkr overcomingchallengestodataqualityintheaspreeclinicaltrial
AT orchardsuzanneg overcomingchallengestodataqualityintheaspreeclinicaltrial
AT pruksawongsinkunnapoj overcomingchallengestodataqualityintheaspreeclinicaltrial
AT shahrajc overcomingchallengestodataqualityintheaspreeclinicaltrial
AT wolferory overcomingchallengestodataqualityintheaspreeclinicaltrial
AT woodsrobynl overcomingchallengestodataqualityintheaspreeclinicaltrial
AT overcomingchallengestodataqualityintheaspreeclinicaltrial