Cargando…

1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach

BACKGROUND: Computer-aided detection (CAD) using artificial intelligence (AI) to analyze chest radiographs is an important tool for community tuberculosis (TB) screening in high burden countries. Most current algorithms use a universal cut-off score to select individuals for confirmatory TB testing;...

Descripción completa

Detalles Bibliográficos
Autores principales: Sung, Joowhan, Kitonsa, Peter J, Isooba, David, Birabwa, Susan, Malhotra, Akash, Nalutaaya, Annet, Dowdy, David W, Katamba, Achilles, Kendall, Emily A
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10678459/
http://dx.doi.org/10.1093/ofid/ofad500.105
_version_ 1785150366642339840
author Sung, Joowhan
Kitonsa, Peter J
Isooba, David
Birabwa, Susan
Malhotra, Akash
Nalutaaya, Annet
Dowdy, David W
Katamba, Achilles
Kendall, Emily A
author_facet Sung, Joowhan
Kitonsa, Peter J
Isooba, David
Birabwa, Susan
Malhotra, Akash
Nalutaaya, Annet
Dowdy, David W
Katamba, Achilles
Kendall, Emily A
author_sort Sung, Joowhan
collection PubMed
description BACKGROUND: Computer-aided detection (CAD) using artificial intelligence (AI) to analyze chest radiographs is an important tool for community tuberculosis (TB) screening in high burden countries. Most current algorithms use a universal cut-off score to select individuals for confirmatory TB testing; however, using a tailored cut-off based on client demographics (age and sex) may improve performance. METHODS: Community-based TB screening was conducted using portable X-ray with CAD (qXR, [Qure.ai, India]) as part of a cluster-randomized trial in Uganda. Individuals scoring above a specified threshold were offered sputum Xpert Ultra testing. This threshold was initially set at 0.5 (range: 0-1) but was later lowered to 0.2 and then 0.1 for research purposes. For clients with scores ≥ 0.1 who did not undergo Xpert testing, we used multiple imputation to infer Xpert-positive status. We assumed that those with X-ray scores < 0.1 would be Xpert-negative if tested, but considered 0.1% or 0.5% prevalence of Xpert-positive TB in sensitivity analysis. We compared the sensitivity and specificity of using a universal screening threshold of 0.5 versus tailored thresholds based on client age and sex. RESULTS: A total of 15,375 individuals were screened using AI-interpreted digital X-ray, of whom 1,748 (11.4%) had valid sputum Ultra results; 157 (9.0%) tested positive. Assuming that people with qXR scores < 0.1 would test negative on sputum Ultra, the manufacturer-recommended universal threshold of ≥ 0.5 had an estimated sensitivity of 75.8% (95%CI: 70.3-81.6) and specificity of 95.3% (95% CI 95.2-95.4). A sex-differentiated threshold (≥ 0.35 for men, ≥ 0.8 for women) had similar specificity but significantly higher sensitivity: 81.3% (95% CI 76.3-86.3). Sex-stratified thresholds also outperformed a universal threshold when assuming higher positivity among people with qXR scores < 0.1. Stratification by age did not significantly improve accuracy. [Figure: see text] [Figure: see text] [Figure: see text] CONCLUSION: Using differentiated CAD score thresholds based on client sex could improve the accuracy of digital X-ray for TB screening. Future research should validate these findings in other populations and explore the value of incorporating additional client characteristics into TB screening algorithms. DISCLOSURES: All Authors: No reported disclosures
format Online
Article
Text
id pubmed-10678459
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-106784592023-11-27 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach Sung, Joowhan Kitonsa, Peter J Isooba, David Birabwa, Susan Malhotra, Akash Nalutaaya, Annet Dowdy, David W Katamba, Achilles Kendall, Emily A Open Forum Infect Dis Abstract BACKGROUND: Computer-aided detection (CAD) using artificial intelligence (AI) to analyze chest radiographs is an important tool for community tuberculosis (TB) screening in high burden countries. Most current algorithms use a universal cut-off score to select individuals for confirmatory TB testing; however, using a tailored cut-off based on client demographics (age and sex) may improve performance. METHODS: Community-based TB screening was conducted using portable X-ray with CAD (qXR, [Qure.ai, India]) as part of a cluster-randomized trial in Uganda. Individuals scoring above a specified threshold were offered sputum Xpert Ultra testing. This threshold was initially set at 0.5 (range: 0-1) but was later lowered to 0.2 and then 0.1 for research purposes. For clients with scores ≥ 0.1 who did not undergo Xpert testing, we used multiple imputation to infer Xpert-positive status. We assumed that those with X-ray scores < 0.1 would be Xpert-negative if tested, but considered 0.1% or 0.5% prevalence of Xpert-positive TB in sensitivity analysis. We compared the sensitivity and specificity of using a universal screening threshold of 0.5 versus tailored thresholds based on client age and sex. RESULTS: A total of 15,375 individuals were screened using AI-interpreted digital X-ray, of whom 1,748 (11.4%) had valid sputum Ultra results; 157 (9.0%) tested positive. Assuming that people with qXR scores < 0.1 would test negative on sputum Ultra, the manufacturer-recommended universal threshold of ≥ 0.5 had an estimated sensitivity of 75.8% (95%CI: 70.3-81.6) and specificity of 95.3% (95% CI 95.2-95.4). A sex-differentiated threshold (≥ 0.35 for men, ≥ 0.8 for women) had similar specificity but significantly higher sensitivity: 81.3% (95% CI 76.3-86.3). Sex-stratified thresholds also outperformed a universal threshold when assuming higher positivity among people with qXR scores < 0.1. Stratification by age did not significantly improve accuracy. [Figure: see text] [Figure: see text] [Figure: see text] CONCLUSION: Using differentiated CAD score thresholds based on client sex could improve the accuracy of digital X-ray for TB screening. Future research should validate these findings in other populations and explore the value of incorporating additional client characteristics into TB screening algorithms. DISCLOSURES: All Authors: No reported disclosures Oxford University Press 2023-11-27 /pmc/articles/PMC10678459/ http://dx.doi.org/10.1093/ofid/ofad500.105 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of Infectious Diseases Society of America. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Abstract
Sung, Joowhan
Kitonsa, Peter J
Isooba, David
Birabwa, Susan
Malhotra, Akash
Nalutaaya, Annet
Dowdy, David W
Katamba, Achilles
Kendall, Emily A
1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach
title 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach
title_full 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach
title_fullStr 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach
title_full_unstemmed 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach
title_short 1951. Optimizing implementation of artificial intelligence-informed digital X-ray screening for tuberculosis through an age- and sex-differentiated approach
title_sort 1951. optimizing implementation of artificial intelligence-informed digital x-ray screening for tuberculosis through an age- and sex-differentiated approach
topic Abstract
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10678459/
http://dx.doi.org/10.1093/ofid/ofad500.105
work_keys_str_mv AT sungjoowhan 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach
AT kitonsapeterj 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach
AT isoobadavid 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach
AT birabwasusan 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach
AT malhotraakash 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach
AT nalutaayaannet 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach
AT dowdydavidw 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach
AT katambaachilles 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach
AT kendallemilya 1951optimizingimplementationofartificialintelligenceinformeddigitalxrayscreeningfortuberculosisthroughanageandsexdifferentiatedapproach