Abstract:A picture description task is a component of Miro Health's platform for self-administration of neurobehavioral assessments. Picture description has been used as a screening tool for identification of individuals with Alzheimer's disease and mild cognitive impairment (MCI), but currently requires in-person administration and scoring by someone with access to and familiarity with a scoring rubric. The Miro Health implementation allows broader use of this assessment through self-administration and automated processing, analysis, and scoring to deliver clinically useful quantifications of the users' speech production, vocal characteristics, and language. Picture description responses were collected from 62 healthy controls (HC), and 33 participants with MCI: 18 with amnestic MCI (aMCI) and 15 with non-amnestic MCI (naMCI). Speech and language features and contrasts between pairs of features were evaluated for differences in their distributions in the participant subgroups. Picture description features were selected and combined using penalized logistic regression to form risk scores for classification of HC versus MCI as well as HC versus specific MCI subtypes. A picture-description based risk score distinguishes MCI and HC with an area under the receiver operator curve (AUROC) of 0.74. When contrasting specific subtypes of MCI and HC, the classifiers have an AUROC of 0.88 for aMCI versus HC and and AUROC of 0.61 for naMCI versus HC. Tests of association of individual features or contrasts of pairs of features with HC versus aMCI identified 20 features with p-values below 5e-3 and False Discovery Rates (FDRs) at or below 0.113, and 61 contrasts with p-values below 5e-4 and FDRs at or below 0.132. Findings suggest that performance of picture description as a screening tool for MCI detection will vary greatly by MCI subtype or by the proportion of various subtypes in an undifferentiated MCI population. Picture description has been used as a screening tool for identification of individuals with Alzheimer's disease and mild cognitive impairment (MCI) and is a component of Miro Health's platform for self-administration of neurobehavioral assessments. The Miro Health implementation allows broad use of this assessment through self-administration and automated processing, analysis, and scoring to deliver clinically useful quantifications of the users' speech production, vocal characteristics, and language. We analyze picture description responses from healthy controls (HC) and patients with two subtypes of MCI: amnestic MCI (aMCI) and non-amnestic MCI (naMCI). Acoustic features were extracted from recordings of picture description responses and language features were extracted from transcripts of the recordings. Classifiers were built from the picture description features to distinguish HC versus MCI or subtypes of MCI. Classification of HC versus aMCI had better performance than HC versus naMCI. Findings suggest that performance of picture description as a screening tool for MCI detection will vary by MCI subtype or by the proportions of various subtypes in an undifferentiated MCI population. We suggest that it is important for future studies to identify and report the subtypes of the MCI cases under analysis. Separate analyses for each MCI subtype would be most useful.

Development of Thai Picture Description Task for Alzheimer's Screening using Part-of-Speech Tagging

Identification of Alzheimer's Disease Patients Based on Oral Speech Features

Digitized Biomarkers Utilizing Human‐Computer Interaction Sensing Technology for Early Auxiliary Diagnosis of Alzheimer’s Disease

Revealing the Roles of Part-of-Speech Taggers in Alzheimer Disease Detection: Scientific Discovery Using One-Intervention Causal Explanation

A Comparison of Connected Speech Tasks for Detecting Early Alzheimer’s Disease and Mild Cognitive Impairment Using Natural Language Processing and Machine Learning

Evaluating Picture Description Speech for Dementia Detection using Image-text Alignment

Use of the Montreal Cognitive Assessment Thai Version to Discriminate Amnestic Mild Cognitive Impairment from Alzheimer’s Disease and Healthy Controls: Machine Learning Results

Detecting Alzheimer's Disease Using Natural Language Processing of Referential Communication Task Transcripts

Machine Learning Classification of Patients with Amnestic Mild Cognitive Impairment and Non-Amnestic Mild Cognitive Impairment from Written Picture Description Tasks

Varied performance of picture description task as a screening tool across MCI subtypes

Leveraging Pretrained Representations with Task-related Keywords for Alzheimer's Disease Detection

Leveraging Pretrained Representations with Task-Related Keywords for Alzheimer’s Disease Detection

An approach for assisting diagnosis of Alzheimer's disease based on natural language processing

Using Automatic Speech Recognition to Assess Thai Speech Language Fluency in the Montreal Cognitive Assessment (MoCA)

Speech based detection of Alzheimer's disease: a survey of AI techniques, datasets and challenges

HTLML: Hybrid AI Based Model for Detection of Alzheimer's Disease

Language patterns in Japanese patients with Alzheimer disease: A machine learning approach

Multimodal Deep Learning Models for Detecting Dementia From Speech and Transcripts

Automatic Identification of Alzheimer's Disease using Lexical Features extracted from Language Samples

Detecting Linguistic Characteristics of Alzheimer's Dementia by Interpreting Neural Models

Characteristics of Mild Cognitive Impairment Using the Thai Version of the Consortium to Establish a Registry for Alzheimer's Disease Tests: A Multivariate and Machine Learning Study.