Abstract:Background: Story recall is a simple and sensitive cognitive test that is commonly used to measure changes in episodic memory function in early Alzheimer disease (AD). Recent advances in digital technology and natural language processing methods make this test a candidate for automated administration and scoring. Multiple parallel test stimuli are required for higher-frequency disease monitoring. Objective: This study aims to develop and validate a remote and fully automated story recall task, suitable for longitudinal assessment, in a population of older adults with and without mild cognitive impairment (MCI) or mild AD. Methods: The "Amyloid Prediction in Early Stage Alzheimer's disease" (AMYPRED) studies recruited participants in the United Kingdom (AMYPRED-UK: NCT04828122) and the United States (AMYPRED-US: NCT04928976). Participants were asked to complete optional daily self-administered assessments remotely on their smart devices over 7 to 8 days. Assessments included immediate and delayed recall of 3 stories from the Automatic Story Recall Task (ASRT), a test with multiple parallel stimuli (18 short stories and 18 long stories) balanced for key linguistic and discourse metrics. Verbal responses were recorded and securely transferred from participants' personal devices and automatically transcribed and scored using text similarity metrics between the source text and retelling to derive a generalized match score. Group differences in adherence and task performance were examined using logistic and linear mixed models, respectively. Correlational analysis examined parallel-forms reliability of ASRTs and convergent validity with cognitive tests (Logical Memory Test and Preclinical Alzheimer's Cognitive Composite with semantic processing). Acceptability and usability data were obtained using a remotely administered questionnaire. Results: Of the 200 participants recruited in the AMYPRED studies, 151 (75.5%)-78 cognitively unimpaired (CU) and 73 MCI or mild AD-engaged in optional remote assessments. Adherence to daily assessment was moderate and did not decline over time but was higher in CU participants (ASRTs were completed each day by 73/106, 68.9% participants with MCI or mild AD and 78/94, 83% CU participants). Participants reported favorable task usability: infrequent technical problems, easy use of the app, and a broad interest in the tasks. Task performance improved modestly across the week and was better for immediate recall. The generalized match scores were lower in participants with MCI or mild AD (Cohen d=1.54). Parallel-forms reliability of ASRT stories was moderate to strong for immediate recall (mean rho 0.73, range 0.56-0.88) and delayed recall (mean rho=0.73, range=0.54-0.86). The ASRTs showed moderate convergent validity with established cognitive tests. Conclusions: The unsupervised, self-administered ASRT task is sensitive to cognitive impairments in MCI and mild AD. The task showed good usability, high parallel-forms reliability, and high convergent validity with established cognitive tests. Remote, low-cost, low-burden, and automatically scored speech assessments could support diagnostic screening, health care, and treatment monitoring.

Stimulus material selection for the Dutch famous faces test for older adults

Assessing cognitive function in longitudinal studies of ageing worldwide: some practical considerations

The Amstel project: design and first findings. The course of mild cognitive impairment of the aged; a longitudinal 4-year study.

Age-Related Differences in the Impact of Prior Knowledge on Recognition Performance: A Face Recognition Study

A Novel Computerized Flexible Attention Test in Detecting Executive Dysfunction of Patients with Early-Onset Cognitive Impairment and Dementia

Facilitating clinical use of the Amsterdam Instrumental Activities of Daily Living Questionnaire: Normative data and a diagnostic cutoff value

Functional near-infrared spectroscopy and vagus somatosensory evoked potentials add to the power of established parameters such as poor cognitive performance, dsyosmia and APOe genotype to predict cognitive decline over 8 years in the elderly

Normative Data for the Famous People Fluency Test in the Adult French-Quebec Population and Validation Study in Mild Cognitive Impairment and Alzheimer’s Disease

The Contribution of the Face-Name Associative Recognition Test to Objectifying the Impairment of Associative Memory in Subjective Cognitive Decline

Single-value brain activity scores reflect both severity and risk across the Alzheimer’s continuum

Single-value brain activity scores reflect both severity and risk across the Alzheimer's continuum

Validation of a Remote and Fully Automated Story Recall Task to Assess for Early Cognitive Impairment in Older Adults: Longitudinal Case-Control Observational Study

Visual associative learning to detect early episodic memory deficits and distinguish Alzheimer's disease from other types of dementia

Detecting Superior Face Recognition Skills in a Large Sample of Young British Adults

Multidimensional measures of person knowledge and spatial associative learning: can these be applied to the differentiation of Alzheimer's disease from frontotemporal and vascular dementia?

[The Visual Association Test to study episodic memory in clinical geriatric psychology]

Comparative Performance of Five Cognitive Screening Tests in a Large Sample of Seniors

The Face-Name Associative Memory Test as a Tool for Early Diagnosis of Alzheimer’s Disease

Measuring Verbal Reasoning and Executive Strategies in German Speaking People with Cognitive-Communication Disorders: Cross-Cultural Adaptation and Pilot Testing of the FAVRES-DE

Predictors of dementia among the oldest old: longitudinal findings from the representative "survey on quality of life and subjective well-being of the very old in North Rhine-Westphalia (NRW80+)"

Reliable Change Indices for the Ruff 2 and 7 Selective Attention Test in Older Adults