Cargando…

Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study

BACKGROUND: Deep learning, which is a part of a broader concept of artificial intelligence (AI) and/or machine learning has achieved remarkable success in vision tasks. While there is growing interest in the use of this technology in diagnostic support for skin-related neglected tropical diseases (s...

Descripción completa

Detalles Bibliográficos
Autores principales: Yotsu, Rie R., Ding, Zhengming, Hamm, Jihun, Blanton, Ronald E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10449179/
https://www.ncbi.nlm.nih.gov/pubmed/37578966
http://dx.doi.org/10.1371/journal.pntd.0011230
_version_ 1785094893779025920
author Yotsu, Rie R.
Ding, Zhengming
Hamm, Jihun
Blanton, Ronald E.
author_facet Yotsu, Rie R.
Ding, Zhengming
Hamm, Jihun
Blanton, Ronald E.
author_sort Yotsu, Rie R.
collection PubMed
description BACKGROUND: Deep learning, which is a part of a broader concept of artificial intelligence (AI) and/or machine learning has achieved remarkable success in vision tasks. While there is growing interest in the use of this technology in diagnostic support for skin-related neglected tropical diseases (skin NTDs), there have been limited studies in this area and fewer focused on dark skin. In this study, we aimed to develop deep learning based AI models with clinical images we collected for five skin NTDs, namely, Buruli ulcer, leprosy, mycetoma, scabies, and yaws, to understand how diagnostic accuracy can or cannot be improved using different models and training patterns. METHODOLOGY: This study used photographs collected prospectively in Côte d’Ivoire and Ghana through our ongoing studies with use of digital health tools for clinical data documentation and for teledermatology. Our dataset included a total of 1,709 images from 506 patients. Two convolutional neural networks, ResNet-50 and VGG-16 models were adopted to examine the performance of different deep learning architectures and validate their feasibility in diagnosis of the targeted skin NTDs. PRINCIPAL FINDINGS: The two models were able to correctly predict over 70% of the diagnoses, and there was a consistent performance improvement with more training samples. The ResNet-50 model performed better than the VGG-16 model. A model trained with PCR confirmed cases of Buruli ulcer yielded 1–3% increase in prediction accuracy across all diseases, except, for mycetoma, over a model which training sets included unconfirmed cases. CONCLUSIONS: Our approach was to have the deep learning model distinguish between multiple pathologies simultaneously–which is close to real-world practice. The more images used for training, the more accurate the diagnosis became. The percentages of correct diagnosis increased with PCR-positive cases of Buruli ulcer. This demonstrated that it may be better to input images from the more accurately diagnosed cases in the training models also for achieving better accuracy in the generated AI models. However, the increase was marginal which may be an indication that the accuracy of clinical diagnosis alone is reliable to an extent for Buruli ulcer. Diagnostic tests also have their flaws, and they are not always reliable. One hope for AI is that it will objectively resolve this gap between diagnostic tests and clinical diagnoses with the addition of another tool. While there are still challenges to be overcome, there is a potential for AI to address the unmet needs where access to medical care is limited, like for those affected by skin NTDs.
format Online
Article
Text
id pubmed-10449179
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-104491792023-08-25 Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study Yotsu, Rie R. Ding, Zhengming Hamm, Jihun Blanton, Ronald E. PLoS Negl Trop Dis Research Article BACKGROUND: Deep learning, which is a part of a broader concept of artificial intelligence (AI) and/or machine learning has achieved remarkable success in vision tasks. While there is growing interest in the use of this technology in diagnostic support for skin-related neglected tropical diseases (skin NTDs), there have been limited studies in this area and fewer focused on dark skin. In this study, we aimed to develop deep learning based AI models with clinical images we collected for five skin NTDs, namely, Buruli ulcer, leprosy, mycetoma, scabies, and yaws, to understand how diagnostic accuracy can or cannot be improved using different models and training patterns. METHODOLOGY: This study used photographs collected prospectively in Côte d’Ivoire and Ghana through our ongoing studies with use of digital health tools for clinical data documentation and for teledermatology. Our dataset included a total of 1,709 images from 506 patients. Two convolutional neural networks, ResNet-50 and VGG-16 models were adopted to examine the performance of different deep learning architectures and validate their feasibility in diagnosis of the targeted skin NTDs. PRINCIPAL FINDINGS: The two models were able to correctly predict over 70% of the diagnoses, and there was a consistent performance improvement with more training samples. The ResNet-50 model performed better than the VGG-16 model. A model trained with PCR confirmed cases of Buruli ulcer yielded 1–3% increase in prediction accuracy across all diseases, except, for mycetoma, over a model which training sets included unconfirmed cases. CONCLUSIONS: Our approach was to have the deep learning model distinguish between multiple pathologies simultaneously–which is close to real-world practice. The more images used for training, the more accurate the diagnosis became. The percentages of correct diagnosis increased with PCR-positive cases of Buruli ulcer. This demonstrated that it may be better to input images from the more accurately diagnosed cases in the training models also for achieving better accuracy in the generated AI models. However, the increase was marginal which may be an indication that the accuracy of clinical diagnosis alone is reliable to an extent for Buruli ulcer. Diagnostic tests also have their flaws, and they are not always reliable. One hope for AI is that it will objectively resolve this gap between diagnostic tests and clinical diagnoses with the addition of another tool. While there are still challenges to be overcome, there is a potential for AI to address the unmet needs where access to medical care is limited, like for those affected by skin NTDs. Public Library of Science 2023-08-14 /pmc/articles/PMC10449179/ /pubmed/37578966 http://dx.doi.org/10.1371/journal.pntd.0011230 Text en © 2023 Yotsu et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Yotsu, Rie R.
Ding, Zhengming
Hamm, Jihun
Blanton, Ronald E.
Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study
title Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study
title_full Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study
title_fullStr Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study
title_full_unstemmed Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study
title_short Deep learning for AI-based diagnosis of skin-related neglected tropical diseases: A pilot study
title_sort deep learning for ai-based diagnosis of skin-related neglected tropical diseases: a pilot study
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10449179/
https://www.ncbi.nlm.nih.gov/pubmed/37578966
http://dx.doi.org/10.1371/journal.pntd.0011230
work_keys_str_mv AT yotsurier deeplearningforaibaseddiagnosisofskinrelatedneglectedtropicaldiseasesapilotstudy
AT dingzhengming deeplearningforaibaseddiagnosisofskinrelatedneglectedtropicaldiseasesapilotstudy
AT hammjihun deeplearningforaibaseddiagnosisofskinrelatedneglectedtropicaldiseasesapilotstudy
AT blantonronalde deeplearningforaibaseddiagnosisofskinrelatedneglectedtropicaldiseasesapilotstudy