Cargando…
A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images
Early detection of Alzheimer’s Disease (AD) is crucial to ensure timely interventions and optimize treatment outcomes for patients. While integrating multi-modal neuroimages, such as MRI and PET, has shown great promise, limited research has been done to effectively handle incomplete multi-modal ima...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cold Spring Harbor Laboratory
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10473798/ https://www.ncbi.nlm.nih.gov/pubmed/37662267 http://dx.doi.org/10.1101/2023.08.24.23294574 |
_version_ | 1785100337233788928 |
---|---|
author | Kwak, Min Gu Su, Yi Chen, Kewei Weidman, David Wu, Teresa Lure, Fleming Li, Jing |
author_facet | Kwak, Min Gu Su, Yi Chen, Kewei Weidman, David Wu, Teresa Lure, Fleming Li, Jing |
author_sort | Kwak, Min Gu |
collection | PubMed |
description | Early detection of Alzheimer’s Disease (AD) is crucial to ensure timely interventions and optimize treatment outcomes for patients. While integrating multi-modal neuroimages, such as MRI and PET, has shown great promise, limited research has been done to effectively handle incomplete multi-modal image datasets in the integration. To this end, we propose a deep learning-based framework that employs Mutual Knowledge Distillation (MKD) to jointly model different sub-cohorts based on their respective available image modalities. In MKD, the model with more modalities (e.g., MRI and PET) is considered a teacher while the model with fewer modalities (e.g., only MRI) is considered a student. Our proposed MKD framework includes three key components: First, we design a teacher model that is student-oriented, namely the Student-oriented Multi-modal Teacher (SMT), through multi-modal information disentanglement. Second, we train the student model by not only minimizing its classification errors but also learning from the SMT teacher. Third, we update the teacher model by transfer learning from the student’s feature extractor because the student model is trained with more samples. Evaluations on Alzheimer’s Disease Neuroimaging Initiative (ADNI) datasets highlight the effectiveness of our method. Our work demonstrates the potential of using AI for addressing the challenges of incomplete multi-modal neuroimage datasets, opening new avenues for advancing early AD detection and treatment strategies. |
format | Online Article Text |
id | pubmed-10473798 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Cold Spring Harbor Laboratory |
record_format | MEDLINE/PubMed |
spelling | pubmed-104737982023-09-02 A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images Kwak, Min Gu Su, Yi Chen, Kewei Weidman, David Wu, Teresa Lure, Fleming Li, Jing medRxiv Article Early detection of Alzheimer’s Disease (AD) is crucial to ensure timely interventions and optimize treatment outcomes for patients. While integrating multi-modal neuroimages, such as MRI and PET, has shown great promise, limited research has been done to effectively handle incomplete multi-modal image datasets in the integration. To this end, we propose a deep learning-based framework that employs Mutual Knowledge Distillation (MKD) to jointly model different sub-cohorts based on their respective available image modalities. In MKD, the model with more modalities (e.g., MRI and PET) is considered a teacher while the model with fewer modalities (e.g., only MRI) is considered a student. Our proposed MKD framework includes three key components: First, we design a teacher model that is student-oriented, namely the Student-oriented Multi-modal Teacher (SMT), through multi-modal information disentanglement. Second, we train the student model by not only minimizing its classification errors but also learning from the SMT teacher. Third, we update the teacher model by transfer learning from the student’s feature extractor because the student model is trained with more samples. Evaluations on Alzheimer’s Disease Neuroimaging Initiative (ADNI) datasets highlight the effectiveness of our method. Our work demonstrates the potential of using AI for addressing the challenges of incomplete multi-modal neuroimage datasets, opening new avenues for advancing early AD detection and treatment strategies. Cold Spring Harbor Laboratory 2023-08-25 /pmc/articles/PMC10473798/ /pubmed/37662267 http://dx.doi.org/10.1101/2023.08.24.23294574 Text en https://creativecommons.org/licenses/by-nc/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (https://creativecommons.org/licenses/by-nc/4.0/) , which allows reusers to distribute, remix, adapt, and build upon the material in any medium or format for noncommercial purposes only, and only so long as attribution is given to the creator. |
spellingShingle | Article Kwak, Min Gu Su, Yi Chen, Kewei Weidman, David Wu, Teresa Lure, Fleming Li, Jing A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images |
title | A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images |
title_full | A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images |
title_fullStr | A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images |
title_full_unstemmed | A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images |
title_short | A Mutual Knowledge Distillation-Empowered AI Framework for Early Detection of Alzheimer’s Disease Using Incomplete Multi-Modal Images |
title_sort | mutual knowledge distillation-empowered ai framework for early detection of alzheimer’s disease using incomplete multi-modal images |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10473798/ https://www.ncbi.nlm.nih.gov/pubmed/37662267 http://dx.doi.org/10.1101/2023.08.24.23294574 |
work_keys_str_mv | AT kwakmingu amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT suyi amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT chenkewei amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT weidmandavid amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT wuteresa amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT lurefleming amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT lijing amutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT kwakmingu mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT suyi mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT chenkewei mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT weidmandavid mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT wuteresa mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT lurefleming mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages AT lijing mutualknowledgedistillationempoweredaiframeworkforearlydetectionofalzheimersdiseaseusingincompletemultimodalimages |