Varied performance of picture description task as a screening tool across MCI subtypes

Joel A. Mefford,Zilong Zhao,Leah Heilier,Man Xu,Guifeng Zhou,Rachel Mace,Kelly L. Sloane,Shannon M. Sheppard,Shenly Glenn
DOI: https://doi.org/10.1371/journal.pdig.0000197
2023-03-14
PLOS Digital Health
Abstract:A picture description task is a component of Miro Health's platform for self-administration of neurobehavioral assessments. Picture description has been used as a screening tool for identification of individuals with Alzheimer's disease and mild cognitive impairment (MCI), but currently requires in-person administration and scoring by someone with access to and familiarity with a scoring rubric. The Miro Health implementation allows broader use of this assessment through self-administration and automated processing, analysis, and scoring to deliver clinically useful quantifications of the users' speech production, vocal characteristics, and language. Picture description responses were collected from 62 healthy controls (HC), and 33 participants with MCI: 18 with amnestic MCI (aMCI) and 15 with non-amnestic MCI (naMCI). Speech and language features and contrasts between pairs of features were evaluated for differences in their distributions in the participant subgroups. Picture description features were selected and combined using penalized logistic regression to form risk scores for classification of HC versus MCI as well as HC versus specific MCI subtypes. A picture-description based risk score distinguishes MCI and HC with an area under the receiver operator curve (AUROC) of 0.74. When contrasting specific subtypes of MCI and HC, the classifiers have an AUROC of 0.88 for aMCI versus HC and and AUROC of 0.61 for naMCI versus HC. Tests of association of individual features or contrasts of pairs of features with HC versus aMCI identified 20 features with p-values below 5e-3 and False Discovery Rates (FDRs) at or below 0.113, and 61 contrasts with p-values below 5e-4 and FDRs at or below 0.132. Findings suggest that performance of picture description as a screening tool for MCI detection will vary greatly by MCI subtype or by the proportion of various subtypes in an undifferentiated MCI population. Picture description has been used as a screening tool for identification of individuals with Alzheimer's disease and mild cognitive impairment (MCI) and is a component of Miro Health's platform for self-administration of neurobehavioral assessments. The Miro Health implementation allows broad use of this assessment through self-administration and automated processing, analysis, and scoring to deliver clinically useful quantifications of the users' speech production, vocal characteristics, and language. We analyze picture description responses from healthy controls (HC) and patients with two subtypes of MCI: amnestic MCI (aMCI) and non-amnestic MCI (naMCI). Acoustic features were extracted from recordings of picture description responses and language features were extracted from transcripts of the recordings. Classifiers were built from the picture description features to distinguish HC versus MCI or subtypes of MCI. Classification of HC versus aMCI had better performance than HC versus naMCI. Findings suggest that performance of picture description as a screening tool for MCI detection will vary by MCI subtype or by the proportions of various subtypes in an undifferentiated MCI population. We suggest that it is important for future studies to identify and report the subtypes of the MCI cases under analysis. Separate analyses for each MCI subtype would be most useful.
What problem does this paper attempt to address?