Cargando…

Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults

BACKGROUND: Online interventions are aiming increasingly at cognitive outcome measures but so far no easy and fast self-monitors for cognition have been validated or proven reliable and feasible. OBJECTIVE: This study examines a new instrument called the Brain Aging Monitor–Cognitive Assessment Batt...

Descripción completa

Detalles Bibliográficos
Autores principales: Aalbers, Teun, Baars, Maria A E, Olde Rikkert, Marcel G M, Kessels, Roy P C
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications Inc. 2013
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3868977/
https://www.ncbi.nlm.nih.gov/pubmed/24300212
http://dx.doi.org/10.2196/jmir.2860
_version_ 1782296522641113088
author Aalbers, Teun
Baars, Maria A E
Olde Rikkert, Marcel G M
Kessels, Roy P C
author_facet Aalbers, Teun
Baars, Maria A E
Olde Rikkert, Marcel G M
Kessels, Roy P C
author_sort Aalbers, Teun
collection PubMed
description BACKGROUND: Online interventions are aiming increasingly at cognitive outcome measures but so far no easy and fast self-monitors for cognition have been validated or proven reliable and feasible. OBJECTIVE: This study examines a new instrument called the Brain Aging Monitor–Cognitive Assessment Battery (BAM-COG) for its alternate forms reliability, face and content validity, and convergent and divergent validity. Also, reference values are provided. METHODS: The BAM-COG consists of four easily accessible, short, yet challenging puzzle games that have been developed to measure working memory (“Conveyer Belt”), visuospatial short-term memory (“Sunshine”), episodic recognition memory (“Viewpoint”), and planning (“Papyrinth”). A total of 641 participants were recruited for this study. Of these, 397 adults, 40 years and older (mean 54.9, SD 9.6), were eligible for analysis. Study participants played all games three times with 14 days in between sets. Face and content validity were based on expert opinion. Alternate forms reliability (AFR) was measured by comparing scores on different versions of the BAM-COG and expressed with an intraclass correlation (ICC: two-way mixed; consistency at 95%). Convergent validity (CV) was provided by comparing BAM-COG scores to gold-standard paper-and-pencil and computer-assisted cognitive assessment. Divergent validity (DV) was measured by comparing BAM-COG scores to the National Adult Reading Test IQ (NART-IQ) estimate. Both CV and DV are expressed as Spearman rho correlation coefficients. RESULTS: Three out of four games showed adequate results on AFR, CV, and DV measures. The games Conveyer Belt, Sunshine, and Papyrinth have AFR ICCs of .420, .426, and .645 respectively. Also, these games had good to very good CV correlations: rho=.577 (P=.001), rho=.669 (P<.001), and rho=.400 (P=.04), respectively. Last, as expected, DV correlations were low: rho=−.029 (P=.44), rho=−.029 (P=.45), and rho=−.134 (P=.28) respectively. The game Viewpoint provided less desirable results with an AFR ICC of .167, CV rho=.202 (P=.15), and DV rho=−.162 (P=.21). CONCLUSIONS: This study provides evidence for the use of the BAM-COG test battery as a feasible, reliable, and valid tool to monitor cognitive performance in healthy adults in an online setting. Three out of four games have good psychometric characteristics to measure working memory, visuospatial short-term memory, and planning capacity.
format Online
Article
Text
id pubmed-3868977
institution National Center for Biotechnology Information
language English
publishDate 2013
publisher JMIR Publications Inc.
record_format MEDLINE/PubMed
spelling pubmed-38689772013-12-20 Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults Aalbers, Teun Baars, Maria A E Olde Rikkert, Marcel G M Kessels, Roy P C J Med Internet Res Original Paper BACKGROUND: Online interventions are aiming increasingly at cognitive outcome measures but so far no easy and fast self-monitors for cognition have been validated or proven reliable and feasible. OBJECTIVE: This study examines a new instrument called the Brain Aging Monitor–Cognitive Assessment Battery (BAM-COG) for its alternate forms reliability, face and content validity, and convergent and divergent validity. Also, reference values are provided. METHODS: The BAM-COG consists of four easily accessible, short, yet challenging puzzle games that have been developed to measure working memory (“Conveyer Belt”), visuospatial short-term memory (“Sunshine”), episodic recognition memory (“Viewpoint”), and planning (“Papyrinth”). A total of 641 participants were recruited for this study. Of these, 397 adults, 40 years and older (mean 54.9, SD 9.6), were eligible for analysis. Study participants played all games three times with 14 days in between sets. Face and content validity were based on expert opinion. Alternate forms reliability (AFR) was measured by comparing scores on different versions of the BAM-COG and expressed with an intraclass correlation (ICC: two-way mixed; consistency at 95%). Convergent validity (CV) was provided by comparing BAM-COG scores to gold-standard paper-and-pencil and computer-assisted cognitive assessment. Divergent validity (DV) was measured by comparing BAM-COG scores to the National Adult Reading Test IQ (NART-IQ) estimate. Both CV and DV are expressed as Spearman rho correlation coefficients. RESULTS: Three out of four games showed adequate results on AFR, CV, and DV measures. The games Conveyer Belt, Sunshine, and Papyrinth have AFR ICCs of .420, .426, and .645 respectively. Also, these games had good to very good CV correlations: rho=.577 (P=.001), rho=.669 (P<.001), and rho=.400 (P=.04), respectively. Last, as expected, DV correlations were low: rho=−.029 (P=.44), rho=−.029 (P=.45), and rho=−.134 (P=.28) respectively. The game Viewpoint provided less desirable results with an AFR ICC of .167, CV rho=.202 (P=.15), and DV rho=−.162 (P=.21). CONCLUSIONS: This study provides evidence for the use of the BAM-COG test battery as a feasible, reliable, and valid tool to monitor cognitive performance in healthy adults in an online setting. Three out of four games have good psychometric characteristics to measure working memory, visuospatial short-term memory, and planning capacity. JMIR Publications Inc. 2013-12-03 /pmc/articles/PMC3868977/ /pubmed/24300212 http://dx.doi.org/10.2196/jmir.2860 Text en ©Teun Aalbers, Maria A E Baars, Marcel G M Olde Rikkert, Roy P C Kessels. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 03.12.2013. http://creativecommons.org/licenses/by/2.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Aalbers, Teun
Baars, Maria A E
Olde Rikkert, Marcel G M
Kessels, Roy P C
Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults
title Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults
title_full Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults
title_fullStr Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults
title_full_unstemmed Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults
title_short Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults
title_sort puzzling with online games (bam-cog): reliability, validity, and feasibility of an online self-monitor for cognitive performance in aging adults
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3868977/
https://www.ncbi.nlm.nih.gov/pubmed/24300212
http://dx.doi.org/10.2196/jmir.2860
work_keys_str_mv AT aalbersteun puzzlingwithonlinegamesbamcogreliabilityvalidityandfeasibilityofanonlineselfmonitorforcognitiveperformanceinagingadults
AT baarsmariaae puzzlingwithonlinegamesbamcogreliabilityvalidityandfeasibilityofanonlineselfmonitorforcognitiveperformanceinagingadults
AT olderikkertmarcelgm puzzlingwithonlinegamesbamcogreliabilityvalidityandfeasibilityofanonlineselfmonitorforcognitiveperformanceinagingadults
AT kesselsroypc puzzlingwithonlinegamesbamcogreliabilityvalidityandfeasibilityofanonlineselfmonitorforcognitiveperformanceinagingadults