Test-retest reliability and minimal detectable change of the Contextual Memory Test in older adults with and without mild cognitive impairment

BACKGROUND: The ability to detect one’s own memory capacity and develop strategies based on daily contexts is important for daily activities. The Contextual Memory Test (CMT) assesses self-awareness, self-efficacy, self-perception/evaluation of performance, recall, and strategy use that are associated with daily contexts, and could be a potentially suitable measurement for assessing memory and meta-memory in older adults with and without cognitive impairment. Nevertheless, the test-retest reliability and minimal detectable change (MDC) remain unknown in these individuals. OBJECTIVE: The purpose of this study was to examine test-retest reliability and calculate MDC of the CMT in healthy older adults and those with mild cognitive impairment (MCI). METHODS: Eighty-three participants completed the CMT twice with a one-month interval. Test-retest reliability was examined using intraclass correlation coefficient (ICC) in all seven domains of the CMT and the recognition subtest. The standard error of measurement (SEM) and MDC were calculated. The Bland-Altman analysis was performed to evaluate the degree of agreement between measurements. RESULTS: The ICC of five domains (self-awareness, self-perception/evaluation of performance, immediate/delayed/total recall) and the recognition subtest were good to excellent (ICC = 0.63–0.94) in healthy and MCI participants and the MDC% were less than 30% The ICC of the other two domains (self-efficacy and total strategy use, TSS) were low (ICC = 0.07–0.59) and the MDC% exceeded 30%. The Bland-Altman analysis showed generally better performance in the 2(nd) than the 1(st) measurement in most CMT domains. CONCLUSIONS: Our results revealed sufficient test-retest reliability and acceptable MDC in most CMT domains in healthy and MCI participants. Only the self-efficacy and TSS domains demonstrated low ICC and large MDC. Possible practice effects were found between repeated measurements. Clinicians should be cautious when evaluating self-efficacy and strategy use using the CMT in older adults. Further improvements are needed for these two domains.