Cargando…

Meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds

INTRODUCTION: For tests reporting continuous results, primary studies usually provide test performance at multiple but often different thresholds. This creates missing data when performing a meta‐analysis at each threshold. A standard meta‐analysis (no imputation [NI]) ignores such missing data. A s...

Descripción completa

Detalles Bibliográficos
Autores principales: Ensor, J., Deeks, J.J., Martin, E.C., Riley, R.D.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5873416/
https://www.ncbi.nlm.nih.gov/pubmed/29052347
http://dx.doi.org/10.1002/jrsm.1276
_version_ 1783310033758453760
author Ensor, J.
Deeks, J.J.
Martin, E.C.
Riley, R.D.
author_facet Ensor, J.
Deeks, J.J.
Martin, E.C.
Riley, R.D.
author_sort Ensor, J.
collection PubMed
description INTRODUCTION: For tests reporting continuous results, primary studies usually provide test performance at multiple but often different thresholds. This creates missing data when performing a meta‐analysis at each threshold. A standard meta‐analysis (no imputation [NI]) ignores such missing data. A single imputation (SI) approach was recently proposed to recover missing threshold results. Here, we propose a new method that performs multiple imputation of the missing threshold results using discrete combinations (MIDC). METHODS: The new MIDC method imputes missing threshold results by randomly selecting from the set of all possible discrete combinations which lie between the results for 2 known bounding thresholds. Imputed and observed results are then synthesised at each threshold. This is repeated multiple times, and the multiple pooled results at each threshold are combined using Rubin's rules to give final estimates. We compared the NI, SI, and MIDC approaches via simulation. RESULTS: Both imputation methods outperform the NI method in simulations. There was generally little difference in the SI and MIDC methods, but the latter was noticeably better in terms of estimating the between‐study variances and generally gave better coverage, due to slightly larger standard errors of pooled estimates. Given selective reporting of thresholds, the imputation methods also reduced bias in the summary receiver operating characteristic curve. Simulations demonstrate the imputation methods rely on an equal threshold spacing assumption. A real example is presented. CONCLUSIONS: The SI and, in particular, MIDC methods can be used to examine the impact of missing threshold results in meta‐analysis of test accuracy studies.
format Online
Article
Text
id pubmed-5873416
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-58734162018-03-31 Meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds Ensor, J. Deeks, J.J. Martin, E.C. Riley, R.D. Res Synth Methods Research Articles INTRODUCTION: For tests reporting continuous results, primary studies usually provide test performance at multiple but often different thresholds. This creates missing data when performing a meta‐analysis at each threshold. A standard meta‐analysis (no imputation [NI]) ignores such missing data. A single imputation (SI) approach was recently proposed to recover missing threshold results. Here, we propose a new method that performs multiple imputation of the missing threshold results using discrete combinations (MIDC). METHODS: The new MIDC method imputes missing threshold results by randomly selecting from the set of all possible discrete combinations which lie between the results for 2 known bounding thresholds. Imputed and observed results are then synthesised at each threshold. This is repeated multiple times, and the multiple pooled results at each threshold are combined using Rubin's rules to give final estimates. We compared the NI, SI, and MIDC approaches via simulation. RESULTS: Both imputation methods outperform the NI method in simulations. There was generally little difference in the SI and MIDC methods, but the latter was noticeably better in terms of estimating the between‐study variances and generally gave better coverage, due to slightly larger standard errors of pooled estimates. Given selective reporting of thresholds, the imputation methods also reduced bias in the summary receiver operating characteristic curve. Simulations demonstrate the imputation methods rely on an equal threshold spacing assumption. A real example is presented. CONCLUSIONS: The SI and, in particular, MIDC methods can be used to examine the impact of missing threshold results in meta‐analysis of test accuracy studies. John Wiley and Sons Inc. 2017-11-22 2018-03 /pmc/articles/PMC5873416/ /pubmed/29052347 http://dx.doi.org/10.1002/jrsm.1276 Text en © 2017 The Authors. Research Synthesis Methods published by John Wiley & Sons Ltd. This is an open access article under the terms of the Creative Commons Attribution (http://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Articles
Ensor, J.
Deeks, J.J.
Martin, E.C.
Riley, R.D.
Meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds
title Meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds
title_full Meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds
title_fullStr Meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds
title_full_unstemmed Meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds
title_short Meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds
title_sort meta‐analysis of test accuracy studies using imputation for partial reporting of multiple thresholds
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5873416/
https://www.ncbi.nlm.nih.gov/pubmed/29052347
http://dx.doi.org/10.1002/jrsm.1276
work_keys_str_mv AT ensorj metaanalysisoftestaccuracystudiesusingimputationforpartialreportingofmultiplethresholds
AT deeksjj metaanalysisoftestaccuracystudiesusingimputationforpartialreportingofmultiplethresholds
AT martinec metaanalysisoftestaccuracystudiesusingimputationforpartialreportingofmultiplethresholds
AT rileyrd metaanalysisoftestaccuracystudiesusingimputationforpartialreportingofmultiplethresholds