Cargando…

A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability

BACKGROUND: Early detection of children with autism spectrum disorder (ASD) and comorbid intellectual disability (ID) can help in individualized intervention. Appropriate assessment and diagnostic tools are lacking in primary care. This study aims to explore the applicability of machine learning (ML...

Descripción completa

Detalles Bibliográficos
Autores principales: Song, Chao, Jiang, Zhong-Quan, Hu, Li-Fei, Li, Wen-Hao, Liu, Xiao-Lin, Wang, Yan-Yan, Jin, Wen-Yuan, Zhu, Zhi-Wei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9533131/
https://www.ncbi.nlm.nih.gov/pubmed/36213933
http://dx.doi.org/10.3389/fpsyt.2022.993077
_version_ 1784802277767249920
author Song, Chao
Jiang, Zhong-Quan
Hu, Li-Fei
Li, Wen-Hao
Liu, Xiao-Lin
Wang, Yan-Yan
Jin, Wen-Yuan
Zhu, Zhi-Wei
author_facet Song, Chao
Jiang, Zhong-Quan
Hu, Li-Fei
Li, Wen-Hao
Liu, Xiao-Lin
Wang, Yan-Yan
Jin, Wen-Yuan
Zhu, Zhi-Wei
author_sort Song, Chao
collection PubMed
description BACKGROUND: Early detection of children with autism spectrum disorder (ASD) and comorbid intellectual disability (ID) can help in individualized intervention. Appropriate assessment and diagnostic tools are lacking in primary care. This study aims to explore the applicability of machine learning (ML) methods in diagnosing ASD comorbid ID compared with traditional regression models. METHOD: From January 2017 to December 2021, 241 children with ASD, with an average age of 6.41 ± 1.96, diagnosed in the Developmental Behavior Department of the Children’s Hospital Affiliated with the Medical College of Zhejiang University were included in the analysis. This study trained the traditional diagnostic models of Logistic regression (LR), Support Vector Machine (SVM), and two ensemble learning algorithms [Random Forest (RF) and XGBoost]. Socio-demographic and behavioral observation data were used to distinguish whether autistic children had combined ID. The hyperparameters adjustment uses grid search and 10-fold validation. The Boruta method is used to select variables. The model’s performance was evaluated using discrimination, calibration, and decision curve analysis (DCA). RESULT: Among 241 autistic children, 98 (40.66%) were ASD comorbid ID. The four diagnostic models can better distinguish whether autistic children are complicated with ID, and the accuracy of SVM is the highest (0.836); SVM and XGBoost have better accuracy (0.800, 0.838); LR has the best sensitivity (0.939), followed by SVM (0.952). Regarding specificity, SVM, RF, and XGBoost performed significantly higher than LR (0.355). The AUC of ML (SVM, 0.835 [95% CI: 0.747–0.944]; RF, 0.829 [95% CI: 0.738–0.920]; XGBoost, 0.845 [95% CI: 0.734–0.937]) is not different from traditional LR (0.858 [95% CI: 0.770–0.944]). Only SVM observed a good calibration degree. Regarding DCA, LR, and SVM have higher benefits in a wider threshold range. CONCLUSION: Compared to the traditional regression model, ML model based on socio-demographic and behavioral observation data, especially SVM, has a better ability to distinguish whether autistic children are combined with ID.
format Online
Article
Text
id pubmed-9533131
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-95331312022-10-06 A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability Song, Chao Jiang, Zhong-Quan Hu, Li-Fei Li, Wen-Hao Liu, Xiao-Lin Wang, Yan-Yan Jin, Wen-Yuan Zhu, Zhi-Wei Front Psychiatry Psychiatry BACKGROUND: Early detection of children with autism spectrum disorder (ASD) and comorbid intellectual disability (ID) can help in individualized intervention. Appropriate assessment and diagnostic tools are lacking in primary care. This study aims to explore the applicability of machine learning (ML) methods in diagnosing ASD comorbid ID compared with traditional regression models. METHOD: From January 2017 to December 2021, 241 children with ASD, with an average age of 6.41 ± 1.96, diagnosed in the Developmental Behavior Department of the Children’s Hospital Affiliated with the Medical College of Zhejiang University were included in the analysis. This study trained the traditional diagnostic models of Logistic regression (LR), Support Vector Machine (SVM), and two ensemble learning algorithms [Random Forest (RF) and XGBoost]. Socio-demographic and behavioral observation data were used to distinguish whether autistic children had combined ID. The hyperparameters adjustment uses grid search and 10-fold validation. The Boruta method is used to select variables. The model’s performance was evaluated using discrimination, calibration, and decision curve analysis (DCA). RESULT: Among 241 autistic children, 98 (40.66%) were ASD comorbid ID. The four diagnostic models can better distinguish whether autistic children are complicated with ID, and the accuracy of SVM is the highest (0.836); SVM and XGBoost have better accuracy (0.800, 0.838); LR has the best sensitivity (0.939), followed by SVM (0.952). Regarding specificity, SVM, RF, and XGBoost performed significantly higher than LR (0.355). The AUC of ML (SVM, 0.835 [95% CI: 0.747–0.944]; RF, 0.829 [95% CI: 0.738–0.920]; XGBoost, 0.845 [95% CI: 0.734–0.937]) is not different from traditional LR (0.858 [95% CI: 0.770–0.944]). Only SVM observed a good calibration degree. Regarding DCA, LR, and SVM have higher benefits in a wider threshold range. CONCLUSION: Compared to the traditional regression model, ML model based on socio-demographic and behavioral observation data, especially SVM, has a better ability to distinguish whether autistic children are combined with ID. Frontiers Media S.A. 2022-09-21 /pmc/articles/PMC9533131/ /pubmed/36213933 http://dx.doi.org/10.3389/fpsyt.2022.993077 Text en Copyright © 2022 Song, Jiang, Hu, Li, Liu, Wang, Jin and Zhu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychiatry
Song, Chao
Jiang, Zhong-Quan
Hu, Li-Fei
Li, Wen-Hao
Liu, Xiao-Lin
Wang, Yan-Yan
Jin, Wen-Yuan
Zhu, Zhi-Wei
A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability
title A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability
title_full A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability
title_fullStr A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability
title_full_unstemmed A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability
title_short A machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability
title_sort machine learning-based diagnostic model for children with autism spectrum disorders complicated with intellectual disability
topic Psychiatry
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9533131/
https://www.ncbi.nlm.nih.gov/pubmed/36213933
http://dx.doi.org/10.3389/fpsyt.2022.993077
work_keys_str_mv AT songchao amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT jiangzhongquan amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT hulifei amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT liwenhao amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT liuxiaolin amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT wangyanyan amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT jinwenyuan amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT zhuzhiwei amachinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT songchao machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT jiangzhongquan machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT hulifei machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT liwenhao machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT liuxiaolin machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT wangyanyan machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT jinwenyuan machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability
AT zhuzhiwei machinelearningbaseddiagnosticmodelforchildrenwithautismspectrumdisorderscomplicatedwithintellectualdisability