Cargando…
Combining Analytical Approaches and Multiple Sources of Information to Improve Interpretation of Diagnostic Test Results for Tuberculosis in Wild Meerkats
SIMPLE SUMMARY: Diagnostic tests used in animals are ideally extensively trialled to ensure that practitioners have confidence in the results; the ideal target should be 100% of infected animals testing positive (sensitivity), and 100% of uninfected animals testing negative (specificity). In these t...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8698085/ https://www.ncbi.nlm.nih.gov/pubmed/34944230 http://dx.doi.org/10.3390/ani11123453 |
_version_ | 1784620193650049024 |
---|---|
author | Patterson, Stuart J. Clarke, Charlene Clutton-Brock, Tim H. Miller, Michele A. Parsons, Sven D. C. Pfeiffer, Dirk U. Vergne, Timothée Drewe, Julian A. |
author_facet | Patterson, Stuart J. Clarke, Charlene Clutton-Brock, Tim H. Miller, Michele A. Parsons, Sven D. C. Pfeiffer, Dirk U. Vergne, Timothée Drewe, Julian A. |
author_sort | Patterson, Stuart J. |
collection | PubMed |
description | SIMPLE SUMMARY: Diagnostic tests used in animals are ideally extensively trialled to ensure that practitioners have confidence in the results; the ideal target should be 100% of infected animals testing positive (sensitivity), and 100% of uninfected animals testing negative (specificity). In these trials, a gold standard is necessary, against which the diagnostic tests may be compared. Commonly, tests of wild animals are not extensively trialled due to shortages of samples and the rarity of gold standard tests. This study uses samples collected for the purpose of diagnosing Mycobacterium suricattae infection in meerkats and estimates the sensitivity and specificity of available tests, both individually, and in combination. A small number of post-mortems (gold standard) were carried out, providing definitive evidence of infected animals against which to compare the tests. In addition, test results were unconventionally compared to survival times and clinical characteristics, aiming to quantify the prognostic capabilities of the tests. The study therefore not only estimates the required parameters against which to assess these tests, but also provides a model for future assessment of diagnostic tests in imperfect field scenarios. Wildlife diseases are increasingly recognised as important to society, and so methods to better quantify these are increasingly important. ABSTRACT: Diagnostic tests are used to classify individual animals’ infection statuses. However, validating test performance in wild animals without gold standard tests is extremely challenging, and the issue is further complicated in chronic conditions where measured immune parameters vary over time. Here, we demonstrate the value of combining evidence from different diagnostic approaches to aid interpretation in the absence of gold standards, large sample sizes, and controlled environments. Over a two-year period, we sampled 268 free-living meerkats (Suricata suricatta) longitudinally for Mycobacterium suricattae (a causative agent of tuberculosis), using three ante-mortem diagnostic tests based on mycobacterial culture, and antigen-specific humoral and cell-mediated immune responses, interpreting results both independently and in combination. Post-mortem cultures confirmed M. suricattae infection in 22 animals, which had prior ante-mortem information, 59% (13/22) of which were test-positive on a parallel test interpretation (PTI) of the three ante-mortem diagnostic assays (95% confidence interval: 37–79%). A similar ability to detect infection, 65.7% (95% credible interval: 42.7–84.7%), was estimated using a Bayesian approach to examine PTI. Strong evidence was found for a near doubling of the hazard of death (Hazard Ratio 1.75, CI: 1.14–2.67, p = 0.01), associated with a positive PTI result, thus demonstrating that these test results are related to disease outcomes. For individual tests, small sample sizes led to wide confidence intervals, but replication of conclusions, using different methods, increased our confidence in these results. This study demonstrates that combining multiple methodologies to evaluate diagnostic tests in free-ranging wildlife populations can be a useful approach for exploiting such valuable datasets. |
format | Online Article Text |
id | pubmed-8698085 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-86980852021-12-24 Combining Analytical Approaches and Multiple Sources of Information to Improve Interpretation of Diagnostic Test Results for Tuberculosis in Wild Meerkats Patterson, Stuart J. Clarke, Charlene Clutton-Brock, Tim H. Miller, Michele A. Parsons, Sven D. C. Pfeiffer, Dirk U. Vergne, Timothée Drewe, Julian A. Animals (Basel) Article SIMPLE SUMMARY: Diagnostic tests used in animals are ideally extensively trialled to ensure that practitioners have confidence in the results; the ideal target should be 100% of infected animals testing positive (sensitivity), and 100% of uninfected animals testing negative (specificity). In these trials, a gold standard is necessary, against which the diagnostic tests may be compared. Commonly, tests of wild animals are not extensively trialled due to shortages of samples and the rarity of gold standard tests. This study uses samples collected for the purpose of diagnosing Mycobacterium suricattae infection in meerkats and estimates the sensitivity and specificity of available tests, both individually, and in combination. A small number of post-mortems (gold standard) were carried out, providing definitive evidence of infected animals against which to compare the tests. In addition, test results were unconventionally compared to survival times and clinical characteristics, aiming to quantify the prognostic capabilities of the tests. The study therefore not only estimates the required parameters against which to assess these tests, but also provides a model for future assessment of diagnostic tests in imperfect field scenarios. Wildlife diseases are increasingly recognised as important to society, and so methods to better quantify these are increasingly important. ABSTRACT: Diagnostic tests are used to classify individual animals’ infection statuses. However, validating test performance in wild animals without gold standard tests is extremely challenging, and the issue is further complicated in chronic conditions where measured immune parameters vary over time. Here, we demonstrate the value of combining evidence from different diagnostic approaches to aid interpretation in the absence of gold standards, large sample sizes, and controlled environments. Over a two-year period, we sampled 268 free-living meerkats (Suricata suricatta) longitudinally for Mycobacterium suricattae (a causative agent of tuberculosis), using three ante-mortem diagnostic tests based on mycobacterial culture, and antigen-specific humoral and cell-mediated immune responses, interpreting results both independently and in combination. Post-mortem cultures confirmed M. suricattae infection in 22 animals, which had prior ante-mortem information, 59% (13/22) of which were test-positive on a parallel test interpretation (PTI) of the three ante-mortem diagnostic assays (95% confidence interval: 37–79%). A similar ability to detect infection, 65.7% (95% credible interval: 42.7–84.7%), was estimated using a Bayesian approach to examine PTI. Strong evidence was found for a near doubling of the hazard of death (Hazard Ratio 1.75, CI: 1.14–2.67, p = 0.01), associated with a positive PTI result, thus demonstrating that these test results are related to disease outcomes. For individual tests, small sample sizes led to wide confidence intervals, but replication of conclusions, using different methods, increased our confidence in these results. This study demonstrates that combining multiple methodologies to evaluate diagnostic tests in free-ranging wildlife populations can be a useful approach for exploiting such valuable datasets. MDPI 2021-12-04 /pmc/articles/PMC8698085/ /pubmed/34944230 http://dx.doi.org/10.3390/ani11123453 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Patterson, Stuart J. Clarke, Charlene Clutton-Brock, Tim H. Miller, Michele A. Parsons, Sven D. C. Pfeiffer, Dirk U. Vergne, Timothée Drewe, Julian A. Combining Analytical Approaches and Multiple Sources of Information to Improve Interpretation of Diagnostic Test Results for Tuberculosis in Wild Meerkats |
title | Combining Analytical Approaches and Multiple Sources of Information to Improve Interpretation of Diagnostic Test Results for Tuberculosis in Wild Meerkats |
title_full | Combining Analytical Approaches and Multiple Sources of Information to Improve Interpretation of Diagnostic Test Results for Tuberculosis in Wild Meerkats |
title_fullStr | Combining Analytical Approaches and Multiple Sources of Information to Improve Interpretation of Diagnostic Test Results for Tuberculosis in Wild Meerkats |
title_full_unstemmed | Combining Analytical Approaches and Multiple Sources of Information to Improve Interpretation of Diagnostic Test Results for Tuberculosis in Wild Meerkats |
title_short | Combining Analytical Approaches and Multiple Sources of Information to Improve Interpretation of Diagnostic Test Results for Tuberculosis in Wild Meerkats |
title_sort | combining analytical approaches and multiple sources of information to improve interpretation of diagnostic test results for tuberculosis in wild meerkats |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8698085/ https://www.ncbi.nlm.nih.gov/pubmed/34944230 http://dx.doi.org/10.3390/ani11123453 |
work_keys_str_mv | AT pattersonstuartj combininganalyticalapproachesandmultiplesourcesofinformationtoimproveinterpretationofdiagnostictestresultsfortuberculosisinwildmeerkats AT clarkecharlene combininganalyticalapproachesandmultiplesourcesofinformationtoimproveinterpretationofdiagnostictestresultsfortuberculosisinwildmeerkats AT cluttonbrocktimh combininganalyticalapproachesandmultiplesourcesofinformationtoimproveinterpretationofdiagnostictestresultsfortuberculosisinwildmeerkats AT millermichelea combininganalyticalapproachesandmultiplesourcesofinformationtoimproveinterpretationofdiagnostictestresultsfortuberculosisinwildmeerkats AT parsonssvendc combininganalyticalapproachesandmultiplesourcesofinformationtoimproveinterpretationofdiagnostictestresultsfortuberculosisinwildmeerkats AT pfeifferdirku combininganalyticalapproachesandmultiplesourcesofinformationtoimproveinterpretationofdiagnostictestresultsfortuberculosisinwildmeerkats AT vergnetimothee combininganalyticalapproachesandmultiplesourcesofinformationtoimproveinterpretationofdiagnostictestresultsfortuberculosisinwildmeerkats AT drewejuliana combininganalyticalapproachesandmultiplesourcesofinformationtoimproveinterpretationofdiagnostictestresultsfortuberculosisinwildmeerkats |