Cargando…
1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach
BACKGROUND: Computer-aided detection (CAD) using artificial intelligence (AI) to analyze chest radiographs is an important tool for community tuberculosis (TB) screening in high burden countries. Most current algorithms use a universal cut-off score to select individuals for confirmatory TB testing;...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10678459/ http://dx.doi.org/10.1093/ofid/ofad500.105 |
_version_ | 1785150366642339840 |
---|---|
author | Sung, Joowhan Kitonsa, Peter J Isooba, David Birabwa, Susan Malhotra, Akash Nalutaaya, Annet Dowdy, David W Katamba, Achilles Kendall, Emily A |
author_facet | Sung, Joowhan Kitonsa, Peter J Isooba, David Birabwa, Susan Malhotra, Akash Nalutaaya, Annet Dowdy, David W Katamba, Achilles Kendall, Emily A |
author_sort | Sung, Joowhan |
collection | PubMed |
description | BACKGROUND: Computer-aided detection (CAD) using artificial intelligence (AI) to analyze chest radiographs is an important tool for community tuberculosis (TB) screening in high burden countries. Most current algorithms use a universal cut-off score to select individuals for confirmatory TB testing; however, using a tailored cut-off based on client demographics (age and sex) may improve performance. METHODS: Community-based TB screening was conducted using portable X-ray with CAD (qXR, [Qure.ai, India]) as part of a cluster-randomized trial in Uganda. Individuals scoring above a specified threshold were offered sputum Xpert Ultra testing. This threshold was initially set at 0.5 (range: 0-1) but was later lowered to 0.2 and then 0.1 for research purposes. For clients with scores ≥ 0.1 who did not undergo Xpert testing, we used multiple imputation to infer Xpert-positive status. We assumed that those with X-ray scores < 0.1 would be Xpert-negative if tested, but considered 0.1% or 0.5% prevalence of Xpert-positive TB in sensitivity analysis. We compared the sensitivity and specificity of using a universal screening threshold of 0.5 versus tailored thresholds based on client age and sex. RESULTS: A total of 15,375 individuals were screened using AI-interpreted digital X-ray, of whom 1,748 (11.4%) had valid sputum Ultra results; 157 (9.0%) tested positive. Assuming that people with qXR scores < 0.1 would test negative on sputum Ultra, the manufacturer-recommended universal threshold of ≥ 0.5 had an estimated sensitivity of 75.8% (95%CI: 70.3-81.6) and specificity of 95.3% (95% CI 95.2-95.4). A sex-differentiated threshold (≥ 0.35 for men, ≥ 0.8 for women) had similar specificity but significantly higher sensitivity: 81.3% (95% CI 76.3-86.3). Sex-stratified thresholds also outperformed a universal threshold when assuming higher positivity among people with qXR scores < 0.1. Stratification by age did not significantly improve accuracy. [Figure: see text] [Figure: see text] [Figure: see text] CONCLUSION: Using differentiated CAD score thresholds based on client sex could improve the accuracy of digital X-ray for TB screening. Future research should validate these findings in other populations and explore the value of incorporating additional client characteristics into TB screening algorithms. DISCLOSURES: All Authors: No reported disclosures |
format | Online Article Text |
id | pubmed-10678459 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-106784592023-11-27 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach Sung, Joowhan Kitonsa, Peter J Isooba, David Birabwa, Susan Malhotra, Akash Nalutaaya, Annet Dowdy, David W Katamba, Achilles Kendall, Emily A Open Forum Infect Dis Abstract BACKGROUND: Computer-aided detection (CAD) using artificial intelligence (AI) to analyze chest radiographs is an important tool for community tuberculosis (TB) screening in high burden countries. Most current algorithms use a universal cut-off score to select individuals for confirmatory TB testing; however, using a tailored cut-off based on client demographics (age and sex) may improve performance. METHODS: Community-based TB screening was conducted using portable X-ray with CAD (qXR, [Qure.ai, India]) as part of a cluster-randomized trial in Uganda. Individuals scoring above a specified threshold were offered sputum Xpert Ultra testing. This threshold was initially set at 0.5 (range: 0-1) but was later lowered to 0.2 and then 0.1 for research purposes. For clients with scores ≥ 0.1 who did not undergo Xpert testing, we used multiple imputation to infer Xpert-positive status. We assumed that those with X-ray scores < 0.1 would be Xpert-negative if tested, but considered 0.1% or 0.5% prevalence of Xpert-positive TB in sensitivity analysis. We compared the sensitivity and specificity of using a universal screening threshold of 0.5 versus tailored thresholds based on client age and sex. RESULTS: A total of 15,375 individuals were screened using AI-interpreted digital X-ray, of whom 1,748 (11.4%) had valid sputum Ultra results; 157 (9.0%) tested positive. Assuming that people with qXR scores < 0.1 would test negative on sputum Ultra, the manufacturer-recommended universal threshold of ≥ 0.5 had an estimated sensitivity of 75.8% (95%CI: 70.3-81.6) and specificity of 95.3% (95% CI 95.2-95.4). A sex-differentiated threshold (≥ 0.35 for men, ≥ 0.8 for women) had similar specificity but significantly higher sensitivity: 81.3% (95% CI 76.3-86.3). Sex-stratified thresholds also outperformed a universal threshold when assuming higher positivity among people with qXR scores < 0.1. Stratification by age did not significantly improve accuracy. [Figure: see text] [Figure: see text] [Figure: see text] CONCLUSION: Using differentiated CAD score thresholds based on client sex could improve the accuracy of digital X-ray for TB screening. Future research should validate these findings in other populations and explore the value of incorporating additional client characteristics into TB screening algorithms. DISCLOSURES: All Authors: No reported disclosures Oxford University Press 2023-11-27 /pmc/articles/PMC10678459/ http://dx.doi.org/10.1093/ofid/ofad500.105 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of Infectious Diseases Society of America. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Abstract Sung, Joowhan Kitonsa, Peter J Isooba, David Birabwa, Susan Malhotra, Akash Nalutaaya, Annet Dowdy, David W Katamba, Achilles Kendall, Emily A 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach |
title | 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach |
title_full | 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach |
title_fullStr | 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach |
title_full_unstemmed | 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach |
title_short | 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach |
title_sort | 1951. optimizing implementation of artificial intelligence-informed digital x-ray screening for tuberculosis through an age- and sex-differentiated approach |
topic | Abstract |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10678459/ http://dx.doi.org/10.1093/ofid/ofad500.105 |
work_keys_str_mv | AT sungjoowhan 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach AT kitonsapeterj 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach AT isoobadavid 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach AT birabwasusan 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach AT malhotraakash 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach AT nalutaayaannet 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach AT dowdydavidw 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach AT katambaachilles 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach AT kendallemilya 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach |