Cargando…

Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults

Cognitive workload is increasingly recognized as an important determinant of performance in cognitive tests and daily life activities. Cognitive workload is a measure of physical and mental effort allocation to a task, which can be determined through self-report or physiological measures. However, t...

Descripción completa

Detalles Bibliográficos
Autores principales: Devos, Hannes, Gustafson, Kathleen, Ahmadnezhad, Pedram, Liao, Ke, Mahnken, Jonathan D., Brooks, William M., Burns, Jeffrey M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7766152/
https://www.ncbi.nlm.nih.gov/pubmed/33339224
http://dx.doi.org/10.3390/brainsci10120994
_version_ 1783628650733633536
author Devos, Hannes
Gustafson, Kathleen
Ahmadnezhad, Pedram
Liao, Ke
Mahnken, Jonathan D.
Brooks, William M.
Burns, Jeffrey M.
author_facet Devos, Hannes
Gustafson, Kathleen
Ahmadnezhad, Pedram
Liao, Ke
Mahnken, Jonathan D.
Brooks, William M.
Burns, Jeffrey M.
author_sort Devos, Hannes
collection PubMed
description Cognitive workload is increasingly recognized as an important determinant of performance in cognitive tests and daily life activities. Cognitive workload is a measure of physical and mental effort allocation to a task, which can be determined through self-report or physiological measures. However, the reliability and validity of these measures have not been established in older adults with a wide range of cognitive ability. The aim of this study was to establish the test–retest reliability of the National Aeronautics and Space Administration Task Load Index (NASA-TLX) and Index of Cognitive Activity (ICA), extracted from pupillary size. The convergent validity of these measures against event-related potentials (ERPs) was also investigated. A total of 38 individuals with scores on the Montreal Cognitive Assessment ranging between 17 and 30 completed a working memory test (n-back) with three levels of difficulty at baseline and at a two-week follow-up. The intraclass correlation coefficients (ICC) values of the NASA-TLX ranged between 0.71 and 0.81, demonstrating good to excellent reliability. The mean ICA scores showed fair to good reliability, with ICCs ranging between 0.56 and 0.73. The mean ICA and NASA-TLX scores showed significant and moderate correlations (Pearson’s r ranging between 0.30 and 0.33) with the third positive peak of the ERP at the midline channels. We conclude that ICA and NASA-TLX are reliable measures of cognitive workload in older adults. Further research is needed in dissecting the subjective and objective constructs of cognitive workload.
format Online
Article
Text
id pubmed-7766152
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-77661522020-12-28 Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults Devos, Hannes Gustafson, Kathleen Ahmadnezhad, Pedram Liao, Ke Mahnken, Jonathan D. Brooks, William M. Burns, Jeffrey M. Brain Sci Article Cognitive workload is increasingly recognized as an important determinant of performance in cognitive tests and daily life activities. Cognitive workload is a measure of physical and mental effort allocation to a task, which can be determined through self-report or physiological measures. However, the reliability and validity of these measures have not been established in older adults with a wide range of cognitive ability. The aim of this study was to establish the test–retest reliability of the National Aeronautics and Space Administration Task Load Index (NASA-TLX) and Index of Cognitive Activity (ICA), extracted from pupillary size. The convergent validity of these measures against event-related potentials (ERPs) was also investigated. A total of 38 individuals with scores on the Montreal Cognitive Assessment ranging between 17 and 30 completed a working memory test (n-back) with three levels of difficulty at baseline and at a two-week follow-up. The intraclass correlation coefficients (ICC) values of the NASA-TLX ranged between 0.71 and 0.81, demonstrating good to excellent reliability. The mean ICA scores showed fair to good reliability, with ICCs ranging between 0.56 and 0.73. The mean ICA and NASA-TLX scores showed significant and moderate correlations (Pearson’s r ranging between 0.30 and 0.33) with the third positive peak of the ERP at the midline channels. We conclude that ICA and NASA-TLX are reliable measures of cognitive workload in older adults. Further research is needed in dissecting the subjective and objective constructs of cognitive workload. MDPI 2020-12-16 /pmc/articles/PMC7766152/ /pubmed/33339224 http://dx.doi.org/10.3390/brainsci10120994 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Devos, Hannes
Gustafson, Kathleen
Ahmadnezhad, Pedram
Liao, Ke
Mahnken, Jonathan D.
Brooks, William M.
Burns, Jeffrey M.
Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults
title Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults
title_full Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults
title_fullStr Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults
title_full_unstemmed Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults
title_short Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults
title_sort psychometric properties of nasa-tlx and index of cognitive activity as measures of cognitive workload in older adults
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7766152/
https://www.ncbi.nlm.nih.gov/pubmed/33339224
http://dx.doi.org/10.3390/brainsci10120994
work_keys_str_mv AT devoshannes psychometricpropertiesofnasatlxandindexofcognitiveactivityasmeasuresofcognitiveworkloadinolderadults
AT gustafsonkathleen psychometricpropertiesofnasatlxandindexofcognitiveactivityasmeasuresofcognitiveworkloadinolderadults
AT ahmadnezhadpedram psychometricpropertiesofnasatlxandindexofcognitiveactivityasmeasuresofcognitiveworkloadinolderadults
AT liaoke psychometricpropertiesofnasatlxandindexofcognitiveactivityasmeasuresofcognitiveworkloadinolderadults
AT mahnkenjonathand psychometricpropertiesofnasatlxandindexofcognitiveactivityasmeasuresofcognitiveworkloadinolderadults
AT brookswilliamm psychometricpropertiesofnasatlxandindexofcognitiveactivityasmeasuresofcognitiveworkloadinolderadults
AT burnsjeffreym psychometricpropertiesofnasatlxandindexofcognitiveactivityasmeasuresofcognitiveworkloadinolderadults