Cargando…

Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies

BACKGROUND: In meta-analyses of diagnostic test accuracy, routinely only one pair of sensitivity and specificity per study is used. However, for tests based on a biomarker or a questionnaire often more than one threshold and the corresponding values of true positives, true negatives, false positives...

Descripción completa

Detalles Bibliográficos
Autores principales: Steinhauser, Susanne, Schumacher, Martin, Rücker, Gerta
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4983029/
https://www.ncbi.nlm.nih.gov/pubmed/27520527
http://dx.doi.org/10.1186/s12874-016-0196-1
_version_ 1782447845684543488
author Steinhauser, Susanne
Schumacher, Martin
Rücker, Gerta
author_facet Steinhauser, Susanne
Schumacher, Martin
Rücker, Gerta
author_sort Steinhauser, Susanne
collection PubMed
description BACKGROUND: In meta-analyses of diagnostic test accuracy, routinely only one pair of sensitivity and specificity per study is used. However, for tests based on a biomarker or a questionnaire often more than one threshold and the corresponding values of true positives, true negatives, false positives and false negatives are known. METHODS: We present a new meta-analysis approach using this additional information. It is based on the idea of estimating the distribution functions of the underlying biomarker or questionnaire within the non-diseased and diseased individuals. Assuming a normal or logistic distribution, we estimate the distribution parameters in both groups applying a linear mixed effects model to the transformed data. The model accounts for across-study heterogeneity and dependence of sensitivity and specificity. In addition, a simulation study is presented. RESULTS: We obtain a summary receiver operating characteristic (SROC) curve as well as the pooled sensitivity and specificity at every specific threshold. Furthermore, the determination of an optimal threshold across studies is possible through maximization of the Youden index. We demonstrate our approach using two meta-analyses of B type natriuretic peptide in heart failure and procalcitonin as a marker for sepsis. CONCLUSIONS: Our approach uses all the available information and results in an estimation not only of the performance of the biomarker but also of the threshold at which the optimal performance can be expected. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12874-016-0196-1) contains supplementary material, which is available to authorized users.
format Online
Article
Text
id pubmed-4983029
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-49830292016-08-14 Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies Steinhauser, Susanne Schumacher, Martin Rücker, Gerta BMC Med Res Methodol Research Article BACKGROUND: In meta-analyses of diagnostic test accuracy, routinely only one pair of sensitivity and specificity per study is used. However, for tests based on a biomarker or a questionnaire often more than one threshold and the corresponding values of true positives, true negatives, false positives and false negatives are known. METHODS: We present a new meta-analysis approach using this additional information. It is based on the idea of estimating the distribution functions of the underlying biomarker or questionnaire within the non-diseased and diseased individuals. Assuming a normal or logistic distribution, we estimate the distribution parameters in both groups applying a linear mixed effects model to the transformed data. The model accounts for across-study heterogeneity and dependence of sensitivity and specificity. In addition, a simulation study is presented. RESULTS: We obtain a summary receiver operating characteristic (SROC) curve as well as the pooled sensitivity and specificity at every specific threshold. Furthermore, the determination of an optimal threshold across studies is possible through maximization of the Youden index. We demonstrate our approach using two meta-analyses of B type natriuretic peptide in heart failure and procalcitonin as a marker for sepsis. CONCLUSIONS: Our approach uses all the available information and results in an estimation not only of the performance of the biomarker but also of the threshold at which the optimal performance can be expected. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12874-016-0196-1) contains supplementary material, which is available to authorized users. BioMed Central 2016-08-12 /pmc/articles/PMC4983029/ /pubmed/27520527 http://dx.doi.org/10.1186/s12874-016-0196-1 Text en © The Author(s) 2016 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
spellingShingle Research Article
Steinhauser, Susanne
Schumacher, Martin
Rücker, Gerta
Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies
title Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies
title_full Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies
title_fullStr Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies
title_full_unstemmed Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies
title_short Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies
title_sort modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4983029/
https://www.ncbi.nlm.nih.gov/pubmed/27520527
http://dx.doi.org/10.1186/s12874-016-0196-1
work_keys_str_mv AT steinhausersusanne modellingmultiplethresholdsinmetaanalysisofdiagnostictestaccuracystudies
AT schumachermartin modellingmultiplethresholdsinmetaanalysisofdiagnostictestaccuracystudies
AT ruckergerta modellingmultiplethresholdsinmetaanalysisofdiagnostictestaccuracystudies