Cargando…

A Digital Screening System for Alzheimer Disease Based on a Neuropsychological Test and a Convolutional Neural Network: System Development and Validation

BACKGROUND: Alzheimer disease (AD) and other types of dementia are now considered one of the world’s most pressing health problems for aging people worldwide. It was the seventh-leading cause of death, globally, in 2019. With a growing number of patients with dementia and increasing costs for treatm...

Descripción completa

Detalles Bibliográficos
Autores principales: Cheah, Wen-Ting, Hwang, Jwu-Jia, Hong, Sheng-Yi, Fu, Li-Chen, Chang, Yu-Ling, Chen, Ta-Fu, Chen, I-An, Chou, Chun-Chen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8943541/
https://www.ncbi.nlm.nih.gov/pubmed/35262497
http://dx.doi.org/10.2196/31106
_version_ 1784673540408082432
author Cheah, Wen-Ting
Hwang, Jwu-Jia
Hong, Sheng-Yi
Fu, Li-Chen
Chang, Yu-Ling
Chen, Ta-Fu
Chen, I-An
Chou, Chun-Chen
author_facet Cheah, Wen-Ting
Hwang, Jwu-Jia
Hong, Sheng-Yi
Fu, Li-Chen
Chang, Yu-Ling
Chen, Ta-Fu
Chen, I-An
Chou, Chun-Chen
author_sort Cheah, Wen-Ting
collection PubMed
description BACKGROUND: Alzheimer disease (AD) and other types of dementia are now considered one of the world’s most pressing health problems for aging people worldwide. It was the seventh-leading cause of death, globally, in 2019. With a growing number of patients with dementia and increasing costs for treatment and care, early detection of the disease at the stage of mild cognitive impairment (MCI) will prevent the rapid progression of dementia. In addition to reducing the physical and psychological stress of patients’ caregivers in the long term, it will also improve the everyday quality of life of patients. OBJECTIVE: The aim of this study was to design a digital screening system to discriminate between patients with MCI and AD and healthy controls (HCs), based on the Rey-Osterrieth Complex Figure (ROCF) neuropsychological test. METHODS: The study took place at National Taiwan University between 2018 and 2019. In order to develop the system, pretraining was performed using, and features were extracted from, an open sketch data set using a data-driven deep learning approach through a convolutional neural network. Later, the learned features were transferred to our collected data set to further train the classifier. The first data set was collected using pen and paper for the traditional method. The second data set used a tablet and smart pen for data collection. The system’s performance was then evaluated using the data sets. RESULTS: The performance of the designed system when using the data set that was collected using the traditional pen and paper method resulted in a mean area under the receiver operating characteristic curve (AUROC) of 0.913 (SD 0.004) when distinguishing between patients with MCI and HCs. On the other hand, when discriminating between patients with AD and HCs, the mean AUROC was 0.950 (SD 0.003) when using the data set that was collected using the digitalized method. CONCLUSIONS: The automatic ROCF test scoring system that we designed showed satisfying results for differentiating between patients with AD and MCI and HCs. Comparatively, our proposed network architecture provided better performance than our previous work, which did not include data augmentation and dropout techniques. In addition, it also performed better than other existing network architectures, such as AlexNet and Sketch-a-Net, with transfer learning techniques. The proposed system can be incorporated with other tests to assist clinicians in the early diagnosis of AD and to reduce the physical and mental burden on patients’ family and friends.
format Online
Article
Text
id pubmed-8943541
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-89435412022-03-25 A Digital Screening System for Alzheimer Disease Based on a Neuropsychological Test and a Convolutional Neural Network: System Development and Validation Cheah, Wen-Ting Hwang, Jwu-Jia Hong, Sheng-Yi Fu, Li-Chen Chang, Yu-Ling Chen, Ta-Fu Chen, I-An Chou, Chun-Chen JMIR Med Inform Original Paper BACKGROUND: Alzheimer disease (AD) and other types of dementia are now considered one of the world’s most pressing health problems for aging people worldwide. It was the seventh-leading cause of death, globally, in 2019. With a growing number of patients with dementia and increasing costs for treatment and care, early detection of the disease at the stage of mild cognitive impairment (MCI) will prevent the rapid progression of dementia. In addition to reducing the physical and psychological stress of patients’ caregivers in the long term, it will also improve the everyday quality of life of patients. OBJECTIVE: The aim of this study was to design a digital screening system to discriminate between patients with MCI and AD and healthy controls (HCs), based on the Rey-Osterrieth Complex Figure (ROCF) neuropsychological test. METHODS: The study took place at National Taiwan University between 2018 and 2019. In order to develop the system, pretraining was performed using, and features were extracted from, an open sketch data set using a data-driven deep learning approach through a convolutional neural network. Later, the learned features were transferred to our collected data set to further train the classifier. The first data set was collected using pen and paper for the traditional method. The second data set used a tablet and smart pen for data collection. The system’s performance was then evaluated using the data sets. RESULTS: The performance of the designed system when using the data set that was collected using the traditional pen and paper method resulted in a mean area under the receiver operating characteristic curve (AUROC) of 0.913 (SD 0.004) when distinguishing between patients with MCI and HCs. On the other hand, when discriminating between patients with AD and HCs, the mean AUROC was 0.950 (SD 0.003) when using the data set that was collected using the digitalized method. CONCLUSIONS: The automatic ROCF test scoring system that we designed showed satisfying results for differentiating between patients with AD and MCI and HCs. Comparatively, our proposed network architecture provided better performance than our previous work, which did not include data augmentation and dropout techniques. In addition, it also performed better than other existing network architectures, such as AlexNet and Sketch-a-Net, with transfer learning techniques. The proposed system can be incorporated with other tests to assist clinicians in the early diagnosis of AD and to reduce the physical and mental burden on patients’ family and friends. JMIR Publications 2022-03-09 /pmc/articles/PMC8943541/ /pubmed/35262497 http://dx.doi.org/10.2196/31106 Text en ©Wen-Ting Cheah, Jwu-Jia Hwang, Sheng-Yi Hong, Li-Chen Fu, Yu-Ling Chang, Ta-Fu Chen, I-An Chen, Chun-Chen Chou. Originally published in JMIR Medical Informatics (https://medinform.jmir.org), 09.03.2022. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Medical Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://medinform.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Cheah, Wen-Ting
Hwang, Jwu-Jia
Hong, Sheng-Yi
Fu, Li-Chen
Chang, Yu-Ling
Chen, Ta-Fu
Chen, I-An
Chou, Chun-Chen
A Digital Screening System for Alzheimer Disease Based on a Neuropsychological Test and a Convolutional Neural Network: System Development and Validation
title A Digital Screening System for Alzheimer Disease Based on a Neuropsychological Test and a Convolutional Neural Network: System Development and Validation
title_full A Digital Screening System for Alzheimer Disease Based on a Neuropsychological Test and a Convolutional Neural Network: System Development and Validation
title_fullStr A Digital Screening System for Alzheimer Disease Based on a Neuropsychological Test and a Convolutional Neural Network: System Development and Validation
title_full_unstemmed A Digital Screening System for Alzheimer Disease Based on a Neuropsychological Test and a Convolutional Neural Network: System Development and Validation
title_short A Digital Screening System for Alzheimer Disease Based on a Neuropsychological Test and a Convolutional Neural Network: System Development and Validation
title_sort digital screening system for alzheimer disease based on a neuropsychological test and a convolutional neural network: system development and validation
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8943541/
https://www.ncbi.nlm.nih.gov/pubmed/35262497
http://dx.doi.org/10.2196/31106
work_keys_str_mv AT cheahwenting adigitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT hwangjwujia adigitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT hongshengyi adigitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT fulichen adigitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT changyuling adigitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT chentafu adigitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT chenian adigitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT chouchunchen adigitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT cheahwenting digitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT hwangjwujia digitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT hongshengyi digitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT fulichen digitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT changyuling digitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT chentafu digitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT chenian digitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation
AT chouchunchen digitalscreeningsystemforalzheimerdiseasebasedonaneuropsychologicaltestandaconvolutionalneuralnetworksystemdevelopmentandvalidation