Cargando…

A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images

Early detection of Alzheimer’s Disease (AD) is crucial to ensure timely interventions and optimize treatment outcomes for patients. While integrating multi-modal neuroimages, such as MRI and PET, has shown great promise, limited research has been done to effectively handle incomplete multi-modal ima...

Descripción completa

Detalles Bibliográficos
Autores principales: Kwak, Min Gu, Su, Yi, Chen, Kewei, Weidman, David, Wu, Teresa, Lure, Fleming, Li, Jing
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cold Spring Harbor Laboratory 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10473798/
https://www.ncbi.nlm.nih.gov/pubmed/37662267
http://dx.doi.org/10.1101/2023.08.24.23294574
_version_ 1785100337233788928
author Kwak, Min Gu
Su, Yi
Chen, Kewei
Weidman, David
Wu, Teresa
Lure, Fleming
Li, Jing
author_facet Kwak, Min Gu
Su, Yi
Chen, Kewei
Weidman, David
Wu, Teresa
Lure, Fleming
Li, Jing
author_sort Kwak, Min Gu
collection PubMed
description Early detection of Alzheimer’s Disease (AD) is crucial to ensure timely interventions and optimize treatment outcomes for patients. While integrating multi-modal neuroimages, such as MRI and PET, has shown great promise, limited research has been done to effectively handle incomplete multi-modal image datasets in the integration. To this end, we propose a deep learning-based framework that employs Mutual Knowledge Distillation (MKD) to jointly model different sub-cohorts based on their respective available image modalities. In MKD, the model with more modalities (e.g., MRI and PET) is considered a teacher while the model with fewer modalities (e.g., only MRI) is considered a student. Our proposed MKD framework includes three key components: First, we design a teacher model that is student-oriented, namely the Student-oriented Multi-modal Teacher (SMT), through multi-modal information disentanglement. Second, we train the student model by not only minimizing its classification errors but also learning from the SMT teacher. Third, we update the teacher model by transfer learning from the student’s feature extractor because the student model is trained with more samples. Evaluations on Alzheimer’s Disease Neuroimaging Initiative (ADNI) datasets highlight the effectiveness of our method. Our work demonstrates the potential of using AI for addressing the challenges of incomplete multi-modal neuroimage datasets, opening new avenues for advancing early AD detection and treatment strategies.
format Online
Article
Text
id pubmed-10473798
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cold Spring Harbor Laboratory
record_format MEDLINE/PubMed
spelling pubmed-104737982023-09-02 A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images Kwak, Min Gu Su, Yi Chen, Kewei Weidman, David Wu, Teresa Lure, Fleming Li, Jing medRxiv Article Early detection of Alzheimer’s Disease (AD) is crucial to ensure timely interventions and optimize treatment outcomes for patients. While integrating multi-modal neuroimages, such as MRI and PET, has shown great promise, limited research has been done to effectively handle incomplete multi-modal image datasets in the integration. To this end, we propose a deep learning-based framework that employs Mutual Knowledge Distillation (MKD) to jointly model different sub-cohorts based on their respective available image modalities. In MKD, the model with more modalities (e.g., MRI and PET) is considered a teacher while the model with fewer modalities (e.g., only MRI) is considered a student. Our proposed MKD framework includes three key components: First, we design a teacher model that is student-oriented, namely the Student-oriented Multi-modal Teacher (SMT), through multi-modal information disentanglement. Second, we train the student model by not only minimizing its classification errors but also learning from the SMT teacher. Third, we update the teacher model by transfer learning from the student’s feature extractor because the student model is trained with more samples. Evaluations on Alzheimer’s Disease Neuroimaging Initiative (ADNI) datasets highlight the effectiveness of our method. Our work demonstrates the potential of using AI for addressing the challenges of incomplete multi-modal neuroimage datasets, opening new avenues for advancing early AD detection and treatment strategies. Cold Spring Harbor Laboratory 2023-08-25 /pmc/articles/PMC10473798/ /pubmed/37662267 http://dx.doi.org/10.1101/2023.08.24.23294574 Text en https://creativecommons.org/licenses/by-nc/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (https://creativecommons.org/licenses/by-nc/4.0/) , which allows reusers to distribute, remix, adapt, and build upon the material in any medium or format for noncommercial purposes only, and only so long as attribution is given to the creator.
spellingShingle Article
Kwak, Min Gu
Su, Yi
Chen, Kewei
Weidman, David
Wu, Teresa
Lure, Fleming
Li, Jing
A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images
title A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images
title_full A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images
title_fullStr A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images
title_full_unstemmed A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images
title_short A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images
title_sort mutual knowledge distillation-empowered ai framework for early detection of alzheimer’s disease using incomplete multi-modal images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10473798/
https://www.ncbi.nlm.nih.gov/pubmed/37662267
http://dx.doi.org/10.1101/2023.08.24.23294574
work_keys_str_mv AT kwakmingu amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT suyi amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT chenkewei amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT weidmandavid amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT wuteresa amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT lurefleming amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT lijing amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT kwakmingu mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT suyi mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT chenkewei mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT weidmandavid mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT wuteresa mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT lurefleming mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages
AT lijing mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages