A multimodal machine learning system in early screening for toddlers with autism spectrum disorders based on the response to name

BACKGROUND: Reduced or absence of the response to name (RTN) has been widely reported as an early specific indicator for autism spectrum disorder (ASD), while few studies have quantified the RTN of toddlers with ASD in an automatic way. The present study aims to apply a multimodal machine learning system (MMLS) in early screening for toddlers with ASD based on the RTN. METHODS: A total of 125 toddlers were recruited, including ASD (n = 61), developmental delay (DD, n = 31), and typical developmental (TD, n = 33). Procedures of RTN were, respectively, performed by the evaluator and caregiver. Behavioral data were collected by eight-definition tripod-mounted cameras and coded by the MMLS. Response score, response time, and response duration time were accurately calculated to evaluate RTN. RESULTS: Total accuracy of RTN scores rated by computers was 0.92. In both evaluator and caregiver procedures, toddlers with ASD had significant differences in response score, response time, and response duration time, compared to toddlers with DD and TD (all P-values < 0.05). The area under the curve (AUC) was 0.81 for the computer-rated results, and the AUC was 0.91 for the human-rated results. The accuracy in the identification of ASD based on the computer- and human-rated results was, respectively, 74.8 and 82.9%. There was a significant difference between the AUC of the human-rated results and computer-rated results (Z = 2.71, P-value = 0.007). CONCLUSION: The multimodal machine learning system can accurately quantify behaviors in RTN procedures and may effectively distinguish toddlers with ASD from the non-ASD group. This novel system may provide a low-cost approach to early screening and identifying toddlers with ASD. However, machine learning is not as accurate as a human observer, and the detection of a single symptom like RTN is not sufficient enough to detect ASD.