Cargando…
A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability
BACKGROUND: Early detection of children with autism spectrum disorder (ASD) and comorbid intellectual disability (ID) can help in individualized intervention. Appropriate assessment and diagnostic tools are lacking in primary care. This study aims to explore the applicability of machine learning (ML...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9533131/ https://www.ncbi.nlm.nih.gov/pubmed/36213933 http://dx.doi.org/10.3389/fpsyt.2022.993077 |
_version_ | 1784802277767249920 |
---|---|
author | Song, Chao Jiang, Zhong-Quan Hu, Li-Fei Li, Wen-Hao Liu, Xiao-Lin Wang, Yan-Yan Jin, Wen-Yuan Zhu, Zhi-Wei |
author_facet | Song, Chao Jiang, Zhong-Quan Hu, Li-Fei Li, Wen-Hao Liu, Xiao-Lin Wang, Yan-Yan Jin, Wen-Yuan Zhu, Zhi-Wei |
author_sort | Song, Chao |
collection | PubMed |
description | BACKGROUND: Early detection of children with autism spectrum disorder (ASD) and comorbid intellectual disability (ID) can help in individualized intervention. Appropriate assessment and diagnostic tools are lacking in primary care. This study aims to explore the applicability of machine learning (ML) methods in diagnosing ASD comorbid ID compared with traditional regression models. METHOD: From January 2017 to December 2021, 241 children with ASD, with an average age of 6.41 ± 1.96, diagnosed in the Developmental Behavior Department of the Children’s Hospital Affiliated with the Medical College of Zhejiang University were included in the analysis. This study trained the traditional diagnostic models of Logistic regression (LR), Support Vector Machine (SVM), and two ensemble learning algorithms [Random Forest (RF) and XGBoost]. Socio-demographic and behavioral observation data were used to distinguish whether autistic children had combined ID. The hyperparameters adjustment uses grid search and 10-fold validation. The Boruta method is used to select variables. The model’s performance was evaluated using discrimination, calibration, and decision curve analysis (DCA). RESULT: Among 241 autistic children, 98 (40.66%) were ASD comorbid ID. The four diagnostic models can better distinguish whether autistic children are complicated with ID, and the accuracy of SVM is the highest (0.836); SVM and XGBoost have better accuracy (0.800, 0.838); LR has the best sensitivity (0.939), followed by SVM (0.952). Regarding specificity, SVM, RF, and XGBoost performed significantly higher than LR (0.355). The AUC of ML (SVM, 0.835 [95% CI: 0.747–0.944]; RF, 0.829 [95% CI: 0.738–0.920]; XGBoost, 0.845 [95% CI: 0.734–0.937]) is not different from traditional LR (0.858 [95% CI: 0.770–0.944]). Only SVM observed a good calibration degree. Regarding DCA, LR, and SVM have higher benefits in a wider threshold range. CONCLUSION: Compared to the traditional regression model, ML model based on socio-demographic and behavioral observation data, especially SVM, has a better ability to distinguish whether autistic children are combined with ID. |
format | Online Article Text |
id | pubmed-9533131 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-95331312022-10-06 A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability Song, Chao Jiang, Zhong-Quan Hu, Li-Fei Li, Wen-Hao Liu, Xiao-Lin Wang, Yan-Yan Jin, Wen-Yuan Zhu, Zhi-Wei Front Psychiatry Psychiatry BACKGROUND: Early detection of children with autism spectrum disorder (ASD) and comorbid intellectual disability (ID) can help in individualized intervention. Appropriate assessment and diagnostic tools are lacking in primary care. This study aims to explore the applicability of machine learning (ML) methods in diagnosing ASD comorbid ID compared with traditional regression models. METHOD: From January 2017 to December 2021, 241 children with ASD, with an average age of 6.41 ± 1.96, diagnosed in the Developmental Behavior Department of the Children’s Hospital Affiliated with the Medical College of Zhejiang University were included in the analysis. This study trained the traditional diagnostic models of Logistic regression (LR), Support Vector Machine (SVM), and two ensemble learning algorithms [Random Forest (RF) and XGBoost]. Socio-demographic and behavioral observation data were used to distinguish whether autistic children had combined ID. The hyperparameters adjustment uses grid search and 10-fold validation. The Boruta method is used to select variables. The model’s performance was evaluated using discrimination, calibration, and decision curve analysis (DCA). RESULT: Among 241 autistic children, 98 (40.66%) were ASD comorbid ID. The four diagnostic models can better distinguish whether autistic children are complicated with ID, and the accuracy of SVM is the highest (0.836); SVM and XGBoost have better accuracy (0.800, 0.838); LR has the best sensitivity (0.939), followed by SVM (0.952). Regarding specificity, SVM, RF, and XGBoost performed significantly higher than LR (0.355). The AUC of ML (SVM, 0.835 [95% CI: 0.747–0.944]; RF, 0.829 [95% CI: 0.738–0.920]; XGBoost, 0.845 [95% CI: 0.734–0.937]) is not different from traditional LR (0.858 [95% CI: 0.770–0.944]). Only SVM observed a good calibration degree. Regarding DCA, LR, and SVM have higher benefits in a wider threshold range. CONCLUSION: Compared to the traditional regression model, ML model based on socio-demographic and behavioral observation data, especially SVM, has a better ability to distinguish whether autistic children are combined with ID. Frontiers Media S.A. 2022-09-21 /pmc/articles/PMC9533131/ /pubmed/36213933 http://dx.doi.org/10.3389/fpsyt.2022.993077 Text en Copyright © 2022 Song, Jiang, Hu, Li, Liu, Wang, Jin and Zhu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychiatry Song, Chao Jiang, Zhong-Quan Hu, Li-Fei Li, Wen-Hao Liu, Xiao-Lin Wang, Yan-Yan Jin, Wen-Yuan Zhu, Zhi-Wei A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability |
title | A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability |
title_full | A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability |
title_fullStr | A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability |
title_full_unstemmed | A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability |
title_short | A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability |
title_sort | machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability |
topic | Psychiatry |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9533131/ https://www.ncbi.nlm.nih.gov/pubmed/36213933 http://dx.doi.org/10.3389/fpsyt.2022.993077 |
work_keys_str_mv | AT songchao amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT jiangzhongquan amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT hulifei amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT liwenhao amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT liuxiaolin amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT wangyanyan amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT jinwenyuan amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT zhuzhiwei amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT songchao machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT jiangzhongquan machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT hulifei machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT liwenhao machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT liuxiaolin machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT wangyanyan machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT jinwenyuan machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability AT zhuzhiwei machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability |