Cargando…

862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App

BACKGROUND: Sore throat is one of the top three reasons for ambulatory pediatric visits in the United States. Approximately one-third of children with sore throat are diagnosed with GAS pharyngitis, for which antibiotics are indicated. Because symptoms and physical exam-based clinical prediction rul...

Descripción completa

Detalles Bibliográficos
Autores principales: Hamdy, Rana F, Nguyen, Trong, Ansusinha, Emily, Arjoune, Youness, Dome, Jeffrey S, Shekhar, Raj
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10677840/
http://dx.doi.org/10.1093/ofid/ofad500.907
_version_ 1785150224894787584
author Hamdy, Rana F
Nguyen, Trong
Ansusinha, Emily
Arjoune, Youness
Dome, Jeffrey S
Shekhar, Raj
author_facet Hamdy, Rana F
Nguyen, Trong
Ansusinha, Emily
Arjoune, Youness
Dome, Jeffrey S
Shekhar, Raj
author_sort Hamdy, Rana F
collection PubMed
description BACKGROUND: Sore throat is one of the top three reasons for ambulatory pediatric visits in the United States. Approximately one-third of children with sore throat are diagnosed with GAS pharyngitis, for which antibiotics are indicated. Because symptoms and physical exam-based clinical prediction rules are insufficient to accurately diagnose GAS pharyngitis, laboratory testing is needed for conclusive diagnosis. Antibiotics are frequently overprescribed for pharyngitis, especially in the telemedicine setting where testing is not readily at hand. We developed a custom mobile app, StrepApp, to capture throat images and apply machine learning (ML) to distinguish GAS pharyngitis from other causes of sore throat. METHODS: We enrolled patients >3 years old presenting with sore throat in the Children’s National Emergency Department. Using StrepApp, we collected throat images and presenting clinical symptoms. We defined GAS pharyngitis as a positive microbiologic GAS test and absence of upper respiratory infection (URI) symptoms; non-GAS pharyngitis was defined as those with negative microbiologic tests. We excluded patients who had received an antibiotic active against GAS in the previous 48 hours, those whose captured images were of poor quality or those with incomplete data, missing labs, or a positive GAS test in a patient presenting with URI symptoms. For ML classification, Scale Invariant Feature Transform (SIFT) was applied to throat images. Visual features were combined with clinical symptoms as input into a support vector machine (SVM) classifier to make a GAS versus non-GAS determination (Figure 1). We calculated sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the trained classifier. [Figure: see text] RESULTS: Of 262 patients enrolled, 148 images were analyzed. Curated images were split into 77 training images and 33 test images (Figure 2). The overall accuracy of the SVM classifier was 93.9%. The sensitivity, specificity, PPV, and NPV were 50.0%, 96.8%, 50.0%, and 96.8%, respectively. [Figure: see text] CONCLUSION: StepApp shows promise to distinguish GAS from non-GAS pharyngitis with high specificity. The small sample size of the database allowed only conventional machine learning. As the database expands, deep learning with superior results may be possible. DISCLOSURES: All Authors: No reported disclosures
format Online
Article
Text
id pubmed-10677840
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-106778402023-11-27 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App Hamdy, Rana F Nguyen, Trong Ansusinha, Emily Arjoune, Youness Dome, Jeffrey S Shekhar, Raj Open Forum Infect Dis Abstract BACKGROUND: Sore throat is one of the top three reasons for ambulatory pediatric visits in the United States. Approximately one-third of children with sore throat are diagnosed with GAS pharyngitis, for which antibiotics are indicated. Because symptoms and physical exam-based clinical prediction rules are insufficient to accurately diagnose GAS pharyngitis, laboratory testing is needed for conclusive diagnosis. Antibiotics are frequently overprescribed for pharyngitis, especially in the telemedicine setting where testing is not readily at hand. We developed a custom mobile app, StrepApp, to capture throat images and apply machine learning (ML) to distinguish GAS pharyngitis from other causes of sore throat. METHODS: We enrolled patients >3 years old presenting with sore throat in the Children’s National Emergency Department. Using StrepApp, we collected throat images and presenting clinical symptoms. We defined GAS pharyngitis as a positive microbiologic GAS test and absence of upper respiratory infection (URI) symptoms; non-GAS pharyngitis was defined as those with negative microbiologic tests. We excluded patients who had received an antibiotic active against GAS in the previous 48 hours, those whose captured images were of poor quality or those with incomplete data, missing labs, or a positive GAS test in a patient presenting with URI symptoms. For ML classification, Scale Invariant Feature Transform (SIFT) was applied to throat images. Visual features were combined with clinical symptoms as input into a support vector machine (SVM) classifier to make a GAS versus non-GAS determination (Figure 1). We calculated sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the trained classifier. [Figure: see text] RESULTS: Of 262 patients enrolled, 148 images were analyzed. Curated images were split into 77 training images and 33 test images (Figure 2). The overall accuracy of the SVM classifier was 93.9%. The sensitivity, specificity, PPV, and NPV were 50.0%, 96.8%, 50.0%, and 96.8%, respectively. [Figure: see text] CONCLUSION: StepApp shows promise to distinguish GAS from non-GAS pharyngitis with high specificity. The small sample size of the database allowed only conventional machine learning. As the database expands, deep learning with superior results may be possible. DISCLOSURES: All Authors: No reported disclosures Oxford University Press 2023-11-27 /pmc/articles/PMC10677840/ http://dx.doi.org/10.1093/ofid/ofad500.907 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of Infectious Diseases Society of America. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Abstract
Hamdy, Rana F
Nguyen, Trong
Ansusinha, Emily
Arjoune, Youness
Dome, Jeffrey S
Shekhar, Raj
862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App
title 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App
title_full 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App
title_fullStr 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App
title_full_unstemmed 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App
title_short 862. Machine Learning to Differentiate Group A Streptococcal (GAS) from Non-GAS Pharyngitis Using a Custom Smartphone App
title_sort 862. machine learning to differentiate group a streptococcal (gas) from non-gas pharyngitis using a custom smartphone app
topic Abstract
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10677840/
http://dx.doi.org/10.1093/ofid/ofad500.907
work_keys_str_mv AT hamdyranaf 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp
AT nguyentrong 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp
AT ansusinhaemily 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp
AT arjouneyouness 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp
AT domejeffreys 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp
AT shekharraj 862machinelearningtodifferentiategroupastreptococcalgasfromnongaspharyngitisusingacustomsmartphoneapp