Measuring Change Over Time on Cognitive Screening Measures: An Evaluation of the Psychometric Properties of ACE-III, CBI-R and EMQ for the Purpose of Dementia Screening

Donnchadh F. Murphy,Jonathan P. Scott,Rupert F. Noad
DOI: https://doi.org/10.1159/000534313
2024-03-13
Dementia and Geriatric Cognitive Disorders
Abstract:Cognitive screening measures are an established part of a dementia assessment, and often include measures of subjective difficulties, e.g., Everyday Memory Questionnaire (EMQ), informant rated difficulty, e.g., Cambridge Behavioural Inventory (CBI-R), and objective cognitive assessments, e.g., Addenbrooke’s Cognitive Examination (ACE-III). While these measures have validity for the purpose of diagnosing dementia, in clinical practice they are often used outside of their evidence base, for the purpose of cognitive re-assessment. The current study sought to evaluate the psychometric properties for the repeated use of these assessments. This study used a longitudinal design, which included 49 healthy controls, 33 people with subjective memory difficulties (SMD) and 10 people with Alzheimer’s Disease (AD) being assessed twice, with approximately a one-year interval between assessments. Results: The EMQ has adequate retest reliability (r=0.78) but people with an AD diagnosis rated their memory as better than those with SDM, making it unsuitable as a measure. The CBI-R had moderate re-test reliability (r=0.62). However, deterioration on the CBI-R was not useful for diagnosing AD. The ACE-III has high re-test reliability (r=0.89). A change of five was associated with reasonable classification accuracy for identifying AD and achieved statistical significance. Conclusion: Using a one-year interval, of the three measures used in this study, only the ACE-III Total Score may be a useful measure of change over time, although it should be applied cautiously due to the lack of representativeness of the sample and change scores should always be triangulated with other forms of evidence of deterioration.
psychiatry,clinical neurology,geriatrics & gerontology,gerontology
What problem does this paper attempt to address?