Cargando…

Bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests

BACKGROUND: Evaluating the accuracy of extrapulmonary tuberculosis (TB) tests is challenging due to lack of a gold standard. Latent class analysis (LCA), a statistical modeling approach, can adjust for reference tests’ imperfect accuracies to produce less biased test accuracy estimates than those pr...

Descripción completa

Detalles Bibliográficos
Autores principales: MacLean, Emily L., Kohli, Mikashmi, Köppel, Lisa, Schiller, Ian, Sharma, Surendra K., Pai, Madhukar, Denkinger, Claudia M., Dendukuri, Nandini
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9202094/
https://www.ncbi.nlm.nih.gov/pubmed/35706064
http://dx.doi.org/10.1186/s41512-022-00125-x
_version_ 1784728457894166528
author MacLean, Emily L.
Kohli, Mikashmi
Köppel, Lisa
Schiller, Ian
Sharma, Surendra K.
Pai, Madhukar
Denkinger, Claudia M.
Dendukuri, Nandini
author_facet MacLean, Emily L.
Kohli, Mikashmi
Köppel, Lisa
Schiller, Ian
Sharma, Surendra K.
Pai, Madhukar
Denkinger, Claudia M.
Dendukuri, Nandini
author_sort MacLean, Emily L.
collection PubMed
description BACKGROUND: Evaluating the accuracy of extrapulmonary tuberculosis (TB) tests is challenging due to lack of a gold standard. Latent class analysis (LCA), a statistical modeling approach, can adjust for reference tests’ imperfect accuracies to produce less biased test accuracy estimates than those produced by commonly used methods like composite reference standards (CRSs). Our objective is to illustrate how Bayesian LCA can address the problem of an unavailable gold standard and demonstrate how it compares to using CRSs for extrapulmonary TB tests. METHODS: We re-analyzed a dataset of presumptive extrapulmonary TB cases in New Delhi, India, for three forms of extrapulmonary TB. Results were available for culture, smear microscopy, Xpert MTB/RIF, and a non-microbiological test, cytopathology/histopathology, or adenosine deaminase (ADA). A diagram was used to define assumed relationships between observed tests and underlying latent variables in the Bayesian LCA with input from an inter-disciplinary team. We compared the results to estimates obtained from a sequence of CRSs defined by increasing numbers of positive reference tests necessary for positive disease status. RESULTS: Data were available from 298, 388, and 230 individuals with presumptive TB lymphadenitis, meningitis, and pleuritis, respectively. Using Bayesian LCA, estimates were obtained for accuracy of all tests and for extrapulmonary TB prevalence. Xpert sensitivity neared that of culture for TB lymphadenitis and meningitis but was lower for TB pleuritis, and specificities of all microbiological tests approached 100%. Non-microbiological tests’ sensitivities were high, but specificities were only moderate, preventing disease rule-in. CRSs’ only provided estimates of Xpert and these varied widely per CRS definition. Accuracy of the CRSs also varied by definition, and no CRS was 100% accurate. CONCLUSION: Unlike CRSs, Bayesian LCA takes into account known information about test performance resulting in accuracy estimates that are easier to interpret. LCA should receive greater consideration for evaluating extrapulmonary TB diagnostic tests. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s41512-022-00125-x.
format Online
Article
Text
id pubmed-9202094
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-92020942022-06-17 Bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests MacLean, Emily L. Kohli, Mikashmi Köppel, Lisa Schiller, Ian Sharma, Surendra K. Pai, Madhukar Denkinger, Claudia M. Dendukuri, Nandini Diagn Progn Res Research BACKGROUND: Evaluating the accuracy of extrapulmonary tuberculosis (TB) tests is challenging due to lack of a gold standard. Latent class analysis (LCA), a statistical modeling approach, can adjust for reference tests’ imperfect accuracies to produce less biased test accuracy estimates than those produced by commonly used methods like composite reference standards (CRSs). Our objective is to illustrate how Bayesian LCA can address the problem of an unavailable gold standard and demonstrate how it compares to using CRSs for extrapulmonary TB tests. METHODS: We re-analyzed a dataset of presumptive extrapulmonary TB cases in New Delhi, India, for three forms of extrapulmonary TB. Results were available for culture, smear microscopy, Xpert MTB/RIF, and a non-microbiological test, cytopathology/histopathology, or adenosine deaminase (ADA). A diagram was used to define assumed relationships between observed tests and underlying latent variables in the Bayesian LCA with input from an inter-disciplinary team. We compared the results to estimates obtained from a sequence of CRSs defined by increasing numbers of positive reference tests necessary for positive disease status. RESULTS: Data were available from 298, 388, and 230 individuals with presumptive TB lymphadenitis, meningitis, and pleuritis, respectively. Using Bayesian LCA, estimates were obtained for accuracy of all tests and for extrapulmonary TB prevalence. Xpert sensitivity neared that of culture for TB lymphadenitis and meningitis but was lower for TB pleuritis, and specificities of all microbiological tests approached 100%. Non-microbiological tests’ sensitivities were high, but specificities were only moderate, preventing disease rule-in. CRSs’ only provided estimates of Xpert and these varied widely per CRS definition. Accuracy of the CRSs also varied by definition, and no CRS was 100% accurate. CONCLUSION: Unlike CRSs, Bayesian LCA takes into account known information about test performance resulting in accuracy estimates that are easier to interpret. LCA should receive greater consideration for evaluating extrapulmonary TB diagnostic tests. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s41512-022-00125-x. BioMed Central 2022-06-16 /pmc/articles/PMC9202094/ /pubmed/35706064 http://dx.doi.org/10.1186/s41512-022-00125-x Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Research
MacLean, Emily L.
Kohli, Mikashmi
Köppel, Lisa
Schiller, Ian
Sharma, Surendra K.
Pai, Madhukar
Denkinger, Claudia M.
Dendukuri, Nandini
Bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests
title Bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests
title_full Bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests
title_fullStr Bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests
title_full_unstemmed Bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests
title_short Bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests
title_sort bayesian latent class analysis produced diagnostic accuracy estimates that were more interpretable than composite reference standards for extrapulmonary tuberculosis tests
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9202094/
https://www.ncbi.nlm.nih.gov/pubmed/35706064
http://dx.doi.org/10.1186/s41512-022-00125-x
work_keys_str_mv AT macleanemilyl bayesianlatentclassanalysisproduceddiagnosticaccuracyestimatesthatweremoreinterpretablethancompositereferencestandardsforextrapulmonarytuberculosistests
AT kohlimikashmi bayesianlatentclassanalysisproduceddiagnosticaccuracyestimatesthatweremoreinterpretablethancompositereferencestandardsforextrapulmonarytuberculosistests
AT koppellisa bayesianlatentclassanalysisproduceddiagnosticaccuracyestimatesthatweremoreinterpretablethancompositereferencestandardsforextrapulmonarytuberculosistests
AT schillerian bayesianlatentclassanalysisproduceddiagnosticaccuracyestimatesthatweremoreinterpretablethancompositereferencestandardsforextrapulmonarytuberculosistests
AT sharmasurendrak bayesianlatentclassanalysisproduceddiagnosticaccuracyestimatesthatweremoreinterpretablethancompositereferencestandardsforextrapulmonarytuberculosistests
AT paimadhukar bayesianlatentclassanalysisproduceddiagnosticaccuracyestimatesthatweremoreinterpretablethancompositereferencestandardsforextrapulmonarytuberculosistests
AT denkingerclaudiam bayesianlatentclassanalysisproduceddiagnosticaccuracyestimatesthatweremoreinterpretablethancompositereferencestandardsforextrapulmonarytuberculosistests
AT dendukurinandini bayesianlatentclassanalysisproduceddiagnosticaccuracyestimatesthatweremoreinterpretablethancompositereferencestandardsforextrapulmonarytuberculosistests