Abstract:Large amounts of labeled data are a prerequisite to training accurate and reliable machine learning models. However, in the medical domain in particular, this is also a stumbling block as accurately labeled data are hard to obtain. DementiaBank, a publicly available corpus of spontaneous speech samples from a picture description task widely used to study Alzheimer's disease (AD) patients' language characteristics and for training classification models to distinguish patients with AD from healthy controls, is relatively small—a limitation that is further exacerbated when restricting to the balanced subset used in the Alzheimer's Dementia Recognition through Spontaneous Speech (ADReSS) challenge. We build on previous work showing that the performance of traditional machine learning models on DementiaBank can be improved by the addition of normative data from other sources, evaluating the utility of such extrinsic data to further improve the performance of state-of-the-art deep learning based methods on the ADReSS challenge dementia detection task. To this end, we developed a new corpus of professionally transcribed recordings from the Wisconsin Longitudinal Study (WLS), resulting in 1366 additional Cookie Theft Task transcripts, increasing the available training data by an order of magnitude. Using these data in conjunction with DementiaBank is challenging because the WLS metadata corresponding to these transcripts do not contain dementia diagnoses. However, cognitive status of WLS participants can be inferred from results of several cognitive tests including semantic verbal fluency available in WLS data. In this work, we evaluate the utility of using the WLS ‘controls’ (participants without indications of abnormal cognitive status), and these data in conjunction with inferred ‘cases’ (participants with such indications) for training deep learning models to discriminate between language produced by patients with dementia and healthy controls. We find that incorporating WLS data during training a BERT model on ADReSS data improves its performance on the ADReSS dementia detection task, supporting the hypothesis that incorporating WLS data adds value in this context. We also demonstrate that weighted cost functions and additional prediction targets may be effective ways to address issues arising from class imbalance and confounding effects due to data provenance.

Development of main concept and core lexicon checklists for the original and modern Cookie Theft stimuli

The Case of the Cookie Jar: Differences in Typical Language Use in Dementia

A new strategy on Early diagnosis of cognitive impairment via novel cross-lingual language markers: a non-invasive description and AI analysis for the cookie theft picture

Examining levels of processing using verbal & pictorial stimuli with the complex trial protocol in a mock theft scenario

Developing image sets for inducing obsessive-compulsive checking symptoms

Measuring word retrieval in narrative discourse: core lexicon in aphasia

Crossing the “Cookie Theft” Corpus Chasm: Applying What BERT Learns From Outside Data to the ADReSS Challenge Dementia Detection Task

Exploring the Cookieverse: A Multi-Perspective Analysis of Web Cookies

Self-control in criminology: we need a broader conceptualization and links to psychiatric diagnoses

CookieEnforcer: Automated Cookie Notice Analysis and Enforcement

Cookie cravings – Examining the impact of sugar content information on Christmas treat preferences via mobile eye-tracking

Automated semantic relevance as an indicator of cognitive decline: Out-of-sample validation on a large-scale longitudinal dataset

Personal data filtering: a systematic literature review comparing the effectiveness of XSS attacks in web applications vs cookie stealing

Measuring food preference and reward: Application and cross-cultural adaptation of the Leeds Food Preference Questionnaire in human experimental research

Personalized assessment of eating disorder cognitions during treatment: A new measure of cognitive pathology change

Neural Correlates of Failed Inhibitory Control As an Early Marker of Disordered Eating in Adolescents

Validated measures of semantic knowledge and semantic control: normative data from young and older adults for more than 300 semantic judgements

Toward Healthier Cookie Habits: Assessing the Role of Packaging Visual Appearance in the Expectations for Dietary Cookies in Digital Environments

The SPEAK study rationale and design: A linguistic corpus-based approach to understanding thought disorder

Towards Browser Controls to Protect Cookies from Malicious Extensions

Cookie Banners, What's the Purpose? Analyzing Cookie Banner Text Through a Legal Lens