Cargando…
862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App
BACKGROUND: Sore throat is one of the top three reasons for ambulatory pediatric visits in the United States. Approximately one-third of children with sore throat are diagnosed with GAS pharyngitis, for which antibiotics are indicated. Because symptoms and physical exam-based clinical prediction rul...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10677840/ http://dx.doi.org/10.1093/ofid/ofad500.907 |
_version_ | 1785150224894787584 |
---|---|
author | Hamdy, Rana F Nguyen, Trong Ansusinha, Emily Arjoune, Youness Dome, Jeffrey S Shekhar, Raj |
author_facet | Hamdy, Rana F Nguyen, Trong Ansusinha, Emily Arjoune, Youness Dome, Jeffrey S Shekhar, Raj |
author_sort | Hamdy, Rana F |
collection | PubMed |
description | BACKGROUND: Sore throat is one of the top three reasons for ambulatory pediatric visits in the United States. Approximately one-third of children with sore throat are diagnosed with GAS pharyngitis, for which antibiotics are indicated. Because symptoms and physical exam-based clinical prediction rules are insufficient to accurately diagnose GAS pharyngitis, laboratory testing is needed for conclusive diagnosis. Antibiotics are frequently overprescribed for pharyngitis, especially in the telemedicine setting where testing is not readily at hand. We developed a custom mobile app, StrepApp, to capture throat images and apply machine learning (ML) to distinguish GAS pharyngitis from other causes of sore throat. METHODS: We enrolled patients >3 years old presenting with sore throat in the Children’s National Emergency Department. Using StrepApp, we collected throat images and presenting clinical symptoms. We defined GAS pharyngitis as a positive microbiologic GAS test and absence of upper respiratory infection (URI) symptoms; non-GAS pharyngitis was defined as those with negative microbiologic tests. We excluded patients who had received an antibiotic active against GAS in the previous 48 hours, those whose captured images were of poor quality or those with incomplete data, missing labs, or a positive GAS test in a patient presenting with URI symptoms. For ML classification, Scale Invariant Feature Transform (SIFT) was applied to throat images. Visual features were combined with clinical symptoms as input into a support vector machine (SVM) classifier to make a GAS versus non-GAS determination (Figure 1). We calculated sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the trained classifier. [Figure: see text] RESULTS: Of 262 patients enrolled, 148 images were analyzed. Curated images were split into 77 training images and 33 test images (Figure 2). The overall accuracy of the SVM classifier was 93.9%. The sensitivity, specificity, PPV, and NPV were 50.0%, 96.8%, 50.0%, and 96.8%, respectively. [Figure: see text] CONCLUSION: StepApp shows promise to distinguish GAS from non-GAS pharyngitis with high specificity. The small sample size of the database allowed only conventional machine learning. As the database expands, deep learning with superior results may be possible. DISCLOSURES: All Authors: No reported disclosures |
format | Online Article Text |
id | pubmed-10677840 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-106778402023-11-27 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App Hamdy, Rana F Nguyen, Trong Ansusinha, Emily Arjoune, Youness Dome, Jeffrey S Shekhar, Raj Open Forum Infect Dis Abstract BACKGROUND: Sore throat is one of the top three reasons for ambulatory pediatric visits in the United States. Approximately one-third of children with sore throat are diagnosed with GAS pharyngitis, for which antibiotics are indicated. Because symptoms and physical exam-based clinical prediction rules are insufficient to accurately diagnose GAS pharyngitis, laboratory testing is needed for conclusive diagnosis. Antibiotics are frequently overprescribed for pharyngitis, especially in the telemedicine setting where testing is not readily at hand. We developed a custom mobile app, StrepApp, to capture throat images and apply machine learning (ML) to distinguish GAS pharyngitis from other causes of sore throat. METHODS: We enrolled patients >3 years old presenting with sore throat in the Children’s National Emergency Department. Using StrepApp, we collected throat images and presenting clinical symptoms. We defined GAS pharyngitis as a positive microbiologic GAS test and absence of upper respiratory infection (URI) symptoms; non-GAS pharyngitis was defined as those with negative microbiologic tests. We excluded patients who had received an antibiotic active against GAS in the previous 48 hours, those whose captured images were of poor quality or those with incomplete data, missing labs, or a positive GAS test in a patient presenting with URI symptoms. For ML classification, Scale Invariant Feature Transform (SIFT) was applied to throat images. Visual features were combined with clinical symptoms as input into a support vector machine (SVM) classifier to make a GAS versus non-GAS determination (Figure 1). We calculated sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the trained classifier. [Figure: see text] RESULTS: Of 262 patients enrolled, 148 images were analyzed. Curated images were split into 77 training images and 33 test images (Figure 2). The overall accuracy of the SVM classifier was 93.9%. The sensitivity, specificity, PPV, and NPV were 50.0%, 96.8%, 50.0%, and 96.8%, respectively. [Figure: see text] CONCLUSION: StepApp shows promise to distinguish GAS from non-GAS pharyngitis with high specificity. The small sample size of the database allowed only conventional machine learning. As the database expands, deep learning with superior results may be possible. DISCLOSURES: All Authors: No reported disclosures Oxford University Press 2023-11-27 /pmc/articles/PMC10677840/ http://dx.doi.org/10.1093/ofid/ofad500.907 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of Infectious Diseases Society of America. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Abstract Hamdy, Rana F Nguyen, Trong Ansusinha, Emily Arjoune, Youness Dome, Jeffrey S Shekhar, Raj 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App |
title | 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App |
title_full | 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App |
title_fullStr | 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App |
title_full_unstemmed | 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App |
title_short | 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App |
title_sort | 862. machine learning to differentiate group a streptococcal (gas) from non-gas pharyngitis using a custom smartphone app |
topic | Abstract |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10677840/ http://dx.doi.org/10.1093/ofid/ofad500.907 |
work_keys_str_mv | AT hamdyranaf 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp AT nguyentrong 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp AT ansusinhaemily 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp AT arjouneyouness 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp AT domejeffreys 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp AT shekharraj 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp |