Cargando…

A comparison of machine learning classifiers for pediatric epilepsy using resting-state functional MRI latency data

Epilepsy affects 1 in 150 children under the age of 10 and is the most common chronic pediatric neurological condition; poor seizure control can irreversibly disrupt normal brain development. The present study compared the ability of different machine learning algorithms trained with resting-state f...

Descripción completa

Detalles Bibliográficos
Autores principales: Nguyen, Ryan D., Smyth, Matthew D., Zhu, Liang, Pao, Ludovic P., Swisher, Shannon K., Kennady, Emmett H., Mitra, Anish, Patel, Rajan P., Lankford, Jeremy E., Von Allmen, Gretchen, Watkins, Michael W., Funke, Michael E., Shah, Manish N.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: D.A. Spandidos 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8330002/
https://www.ncbi.nlm.nih.gov/pubmed/34405049
http://dx.doi.org/10.3892/br.2021.1453
_version_ 1783732612302372864
author Nguyen, Ryan D.
Smyth, Matthew D.
Zhu, Liang
Pao, Ludovic P.
Swisher, Shannon K.
Kennady, Emmett H.
Mitra, Anish
Patel, Rajan P.
Lankford, Jeremy E.
Von Allmen, Gretchen
Watkins, Michael W.
Funke, Michael E.
Shah, Manish N.
author_facet Nguyen, Ryan D.
Smyth, Matthew D.
Zhu, Liang
Pao, Ludovic P.
Swisher, Shannon K.
Kennady, Emmett H.
Mitra, Anish
Patel, Rajan P.
Lankford, Jeremy E.
Von Allmen, Gretchen
Watkins, Michael W.
Funke, Michael E.
Shah, Manish N.
author_sort Nguyen, Ryan D.
collection PubMed
description Epilepsy affects 1 in 150 children under the age of 10 and is the most common chronic pediatric neurological condition; poor seizure control can irreversibly disrupt normal brain development. The present study compared the ability of different machine learning algorithms trained with resting-state functional MRI (rfMRI) latency data to detect epilepsy. Preoperative rfMRI and anatomical MRI scans were obtained for 63 patients with epilepsy and 259 healthy controls. The normal distribution of latency z-scores from the epilepsy and healthy control cohorts were analyzed for overlap in 36 seed regions. In these seed regions, overlap between the study cohorts ranged from 0.44-0.58. Machine learning features were extracted from latency z-score maps using principal component analysis. Extreme Gradient Boosting (XGBoost), Support Vector Machines (SVM), and Random Forest algorithms were trained with these features. Area under the receiver operating characteristics curve (AUC), accuracy, sensitivity, specificity and F1-scores were used to evaluate model performance. The XGBoost model outperformed all other models with a test AUC of 0.79, accuracy of 74%, specificity of 73%, and a sensitivity of 77%. The Random Forest model performed comparably to XGBoost across multiple metrics, but it had a test sensitivity of 31%. The SVM model did not perform >70% in any of the test metrics. The XGBoost model had the highest sensitivity and accuracy for the detection of epilepsy. Development of machine learning algorithms trained with rfMRI latency data could provide an adjunctive method for the diagnosis and evaluation of epilepsy with the goal of enabling timely and appropriate care for patients.
format Online
Article
Text
id pubmed-8330002
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher D.A. Spandidos
record_format MEDLINE/PubMed
spelling pubmed-83300022021-08-16 A comparison of machine learning classifiers for pediatric epilepsy using resting-state functional MRI latency data Nguyen, Ryan D. Smyth, Matthew D. Zhu, Liang Pao, Ludovic P. Swisher, Shannon K. Kennady, Emmett H. Mitra, Anish Patel, Rajan P. Lankford, Jeremy E. Von Allmen, Gretchen Watkins, Michael W. Funke, Michael E. Shah, Manish N. Biomed Rep Articles Epilepsy affects 1 in 150 children under the age of 10 and is the most common chronic pediatric neurological condition; poor seizure control can irreversibly disrupt normal brain development. The present study compared the ability of different machine learning algorithms trained with resting-state functional MRI (rfMRI) latency data to detect epilepsy. Preoperative rfMRI and anatomical MRI scans were obtained for 63 patients with epilepsy and 259 healthy controls. The normal distribution of latency z-scores from the epilepsy and healthy control cohorts were analyzed for overlap in 36 seed regions. In these seed regions, overlap between the study cohorts ranged from 0.44-0.58. Machine learning features were extracted from latency z-score maps using principal component analysis. Extreme Gradient Boosting (XGBoost), Support Vector Machines (SVM), and Random Forest algorithms were trained with these features. Area under the receiver operating characteristics curve (AUC), accuracy, sensitivity, specificity and F1-scores were used to evaluate model performance. The XGBoost model outperformed all other models with a test AUC of 0.79, accuracy of 74%, specificity of 73%, and a sensitivity of 77%. The Random Forest model performed comparably to XGBoost across multiple metrics, but it had a test sensitivity of 31%. The SVM model did not perform >70% in any of the test metrics. The XGBoost model had the highest sensitivity and accuracy for the detection of epilepsy. Development of machine learning algorithms trained with rfMRI latency data could provide an adjunctive method for the diagnosis and evaluation of epilepsy with the goal of enabling timely and appropriate care for patients. D.A. Spandidos 2021-09 2021-07-23 /pmc/articles/PMC8330002/ /pubmed/34405049 http://dx.doi.org/10.3892/br.2021.1453 Text en Copyright: © Nguyen et al. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License (https://creativecommons.org/licenses/by-nc-nd/4.0/) , which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made.
spellingShingle Articles
Nguyen, Ryan D.
Smyth, Matthew D.
Zhu, Liang
Pao, Ludovic P.
Swisher, Shannon K.
Kennady, Emmett H.
Mitra, Anish
Patel, Rajan P.
Lankford, Jeremy E.
Von Allmen, Gretchen
Watkins, Michael W.
Funke, Michael E.
Shah, Manish N.
A comparison of machine learning classifiers for pediatric epilepsy using resting-state functional MRI latency data
title A comparison of machine learning classifiers for pediatric epilepsy using resting-state functional MRI latency data
title_full A comparison of machine learning classifiers for pediatric epilepsy using resting-state functional MRI latency data
title_fullStr A comparison of machine learning classifiers for pediatric epilepsy using resting-state functional MRI latency data
title_full_unstemmed A comparison of machine learning classifiers for pediatric epilepsy using resting-state functional MRI latency data
title_short A comparison of machine learning classifiers for pediatric epilepsy using resting-state functional MRI latency data
title_sort comparison of machine learning classifiers for pediatric epilepsy using resting-state functional mri latency data
topic Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8330002/
https://www.ncbi.nlm.nih.gov/pubmed/34405049
http://dx.doi.org/10.3892/br.2021.1453
work_keys_str_mv AT nguyenryand acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT smythmatthewd acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT zhuliang acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT paoludovicp acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT swishershannonk acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT kennadyemmetth acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT mitraanish acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT patelrajanp acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT lankfordjeremye acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT vonallmengretchen acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT watkinsmichaelw acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT funkemichaele acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT shahmanishn acomparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT nguyenryand comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT smythmatthewd comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT zhuliang comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT paoludovicp comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT swishershannonk comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT kennadyemmetth comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT mitraanish comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT patelrajanp comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT lankfordjeremye comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT vonallmengretchen comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT watkinsmichaelw comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT funkemichaele comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata
AT shahmanishn comparisonofmachinelearningclassifiersforpediatricepilepsyusingrestingstatefunctionalmrilatencydata