Cargando…

Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia

Introduction: Early detection and monitoring of mild cognitive impairment (MCI) and Alzheimer's Disease (AD) patients are key to tackling dementia and providing benefits to patients, caregivers, healthcare providers and society. We developed the Integrated Cognitive Assessment (ICA); a 5-min, l...

Descripción completa

Detalles Bibliográficos
Autores principales: Kalafatis, Chris, Modarres, Mohammad Hadi, Apostolou, Panos, Marefat, Haniye, Khanbagi, Mahdiyeh, Karimi, Hamed, Vahabi, Zahra, Aarsland, Dag, Khaligh-Razavi, Seyed-Mahdi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8339427/
https://www.ncbi.nlm.nih.gov/pubmed/34366938
http://dx.doi.org/10.3389/fpsyt.2021.706695
_version_ 1783733599071109120
author Kalafatis, Chris
Modarres, Mohammad Hadi
Apostolou, Panos
Marefat, Haniye
Khanbagi, Mahdiyeh
Karimi, Hamed
Vahabi, Zahra
Aarsland, Dag
Khaligh-Razavi, Seyed-Mahdi
author_facet Kalafatis, Chris
Modarres, Mohammad Hadi
Apostolou, Panos
Marefat, Haniye
Khanbagi, Mahdiyeh
Karimi, Hamed
Vahabi, Zahra
Aarsland, Dag
Khaligh-Razavi, Seyed-Mahdi
author_sort Kalafatis, Chris
collection PubMed
description Introduction: Early detection and monitoring of mild cognitive impairment (MCI) and Alzheimer's Disease (AD) patients are key to tackling dementia and providing benefits to patients, caregivers, healthcare providers and society. We developed the Integrated Cognitive Assessment (ICA); a 5-min, language independent computerised cognitive test that employs an Artificial Intelligence (AI) model to improve its accuracy in detecting cognitive impairment. In this study, we aimed to evaluate the generalisability of the ICA in detecting cognitive impairment in MCI and mild AD patients. Methods: We studied the ICA in 230 participants. 95 healthy volunteers, 80 MCI, and 55 mild AD participants completed the ICA, Montreal Cognitive Assessment (MoCA) and Addenbrooke's Cognitive Examination (ACE) cognitive tests. Results: The ICA demonstrated convergent validity with MoCA (Pearson r=0.58, p<0.0001) and ACE (r=0.62, p<0.0001). The ICA AI model was able to detect cognitive impairment with an AUC of 81% for MCI patients, and 88% for mild AD patients. The AI model demonstrated improved performance with increased training data and showed generalisability in performance from one population to another. The ICA correlation of 0.17 (p = 0.01) with education years is considerably smaller than that of MoCA (r = 0.34, p < 0.0001) and ACE (r = 0.41, p < 0.0001) which displayed significant correlations. In a separate study the ICA demonstrated no significant practise effect over the duration of the study. Discussion: The ICA can support clinicians by aiding accurate diagnosis of MCI and AD and is appropriate for large-scale screening of cognitive impairment. The ICA is unbiased by differences in language, culture, and education.
format Online
Article
Text
id pubmed-8339427
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-83394272021-08-06 Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia Kalafatis, Chris Modarres, Mohammad Hadi Apostolou, Panos Marefat, Haniye Khanbagi, Mahdiyeh Karimi, Hamed Vahabi, Zahra Aarsland, Dag Khaligh-Razavi, Seyed-Mahdi Front Psychiatry Psychiatry Introduction: Early detection and monitoring of mild cognitive impairment (MCI) and Alzheimer's Disease (AD) patients are key to tackling dementia and providing benefits to patients, caregivers, healthcare providers and society. We developed the Integrated Cognitive Assessment (ICA); a 5-min, language independent computerised cognitive test that employs an Artificial Intelligence (AI) model to improve its accuracy in detecting cognitive impairment. In this study, we aimed to evaluate the generalisability of the ICA in detecting cognitive impairment in MCI and mild AD patients. Methods: We studied the ICA in 230 participants. 95 healthy volunteers, 80 MCI, and 55 mild AD participants completed the ICA, Montreal Cognitive Assessment (MoCA) and Addenbrooke's Cognitive Examination (ACE) cognitive tests. Results: The ICA demonstrated convergent validity with MoCA (Pearson r=0.58, p<0.0001) and ACE (r=0.62, p<0.0001). The ICA AI model was able to detect cognitive impairment with an AUC of 81% for MCI patients, and 88% for mild AD patients. The AI model demonstrated improved performance with increased training data and showed generalisability in performance from one population to another. The ICA correlation of 0.17 (p = 0.01) with education years is considerably smaller than that of MoCA (r = 0.34, p < 0.0001) and ACE (r = 0.41, p < 0.0001) which displayed significant correlations. In a separate study the ICA demonstrated no significant practise effect over the duration of the study. Discussion: The ICA can support clinicians by aiding accurate diagnosis of MCI and AD and is appropriate for large-scale screening of cognitive impairment. The ICA is unbiased by differences in language, culture, and education. Frontiers Media S.A. 2021-07-22 /pmc/articles/PMC8339427/ /pubmed/34366938 http://dx.doi.org/10.3389/fpsyt.2021.706695 Text en Copyright © 2021 Kalafatis, Modarres, Apostolou, Marefat, Khanbagi, Karimi, Vahabi, Aarsland and Khaligh-Razavi. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychiatry
Kalafatis, Chris
Modarres, Mohammad Hadi
Apostolou, Panos
Marefat, Haniye
Khanbagi, Mahdiyeh
Karimi, Hamed
Vahabi, Zahra
Aarsland, Dag
Khaligh-Razavi, Seyed-Mahdi
Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia
title Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia
title_full Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia
title_fullStr Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia
title_full_unstemmed Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia
title_short Validity and Cultural Generalisability of a 5-Minute AI-Based, Computerised Cognitive Assessment in Mild Cognitive Impairment and Alzheimer's Dementia
title_sort validity and cultural generalisability of a 5-minute ai-based, computerised cognitive assessment in mild cognitive impairment and alzheimer's dementia
topic Psychiatry
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8339427/
https://www.ncbi.nlm.nih.gov/pubmed/34366938
http://dx.doi.org/10.3389/fpsyt.2021.706695
work_keys_str_mv AT kalafatischris validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia
AT modarresmohammadhadi validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia
AT apostoloupanos validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia
AT marefathaniye validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia
AT khanbagimahdiyeh validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia
AT karimihamed validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia
AT vahabizahra validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia
AT aarslanddag validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia
AT khalighrazaviseyedmahdi validityandculturalgeneralisabilityofa5minuteaibasedcomputerisedcognitiveassessmentinmildcognitiveimpairmentandalzheimersdementia