Abstract:Background Mindstep is an app that aims to improve dementia screening by assessing cognition and risk factors. It considers important clinical risk factors, including prodromal symptoms, mental health disorders, and differential diagnoses of dementia. The 9-item Patient Health Questionnaire for depression (PHQ-9) and the 7-item Generalized Anxiety Disorder Scale (GAD-7) are widely validated and commonly used scales used in screening for depression and anxiety disorders, respectively. Shortened versions of both (PHQ-2/GAD-2) have been produced. Objective We sought to develop a method that maintained the brevity of these shorter questionnaires while maintaining the better precision of the original questionnaires. Methods Single questions were designed to encompass symptoms covered in the original questionnaires. Answers to these questions were combined with PHQ-2/GAD-2, and anonymized risk factors were collected by Mindset4Dementia from 2235 users. Machine learning models were trained to use these single questions in combination with data already collected by the app: age, response to a joke, and reporting of functional impairment to predict binary and continuous outcomes as measured using PHQ-9/GAD-7. Our model was developed with a training data set by using 10-fold cross-validation and a holdout testing data set and compared to results from using the shorter questionnaires (PHQ-2/GAD-2) alone to benchmark performance. Results We were able to achieve superior performance in predicting PHQ-9/GAD-7 screening cutoffs compared to PHQ-2 (difference in area under the curve 0.04, 95% CI 0.00-0.08, P=.02) but not GAD-2 (difference in area under the curve 0.00, 95% CI –0.02 to 0.03, P=.42). Regression models were able to accurately predict total questionnaire scores in PHQ-9 (R2=0.655, mean absolute error=2.267) and GAD-7 (R2=0.837, mean absolute error=1.780). Conclusions We app-adapted PHQ-4 by adding brief summary questions about factors normally covered in the longer questionnaires. We additionally trained machine learning models that used the wide range of additional information already collected in Mindstep to make a short app-based screening tool for affective disorders, which appears to have superior or equivalent performance to well-established methods.

Making it Short: Shortening the Comprehensive Inventory of Mindfulness Experiences Using Ant Colony Optimization

Short-Scale Construction Using Meta-Analytic Ant Colony Optimization

Validation of the Comprehensive Inventory of Mindfulness Experiences (CHIME) in Portuguese Children

Exploring the applicability of a multifactor mindfulness scale in the Chinese college context

Ant Colony Optimization and Local Weighted Structural Equation Modeling. A Tutorial on Novel Item and Person Sampling Procedures for Personality Research

A Comparison of Metaheuristic Optimization Algorithms for Scale Short-Form Development

Short and sweet: Comparing strategies for the reduction of questionnaires on self‐criticism and social safeness while preserving construct validity

Measuring Global Character Dimensions: An Ant Colony Optimization Approach toward Three Core Strength Scales

The mental imagery scale for art students: Building and validating a short form

The brief mind wandering three-factor scale (BMW-3)

Optimized short-forms of the Cognitive Distortions Questionnaire

Development of the Short Critical Consciousness Scale (ShoCCS)

The Balanced Inventory of Desirable Responding Short Form (BIDR-16)

Validation of the German Five-Factor Narcissism Inventory and Construction of a Brief Form Using Ant Colony Optimization

The Multidimensional Assessment of Interoceptive Awareness, Version 2 (MAIA-2)

Validation of a Chinese version of the five facet mindfulness questionnaire and development of a short form based on item response theory

Optimizing Existing Mental Health Screening Methods in a Dementia Screening and Risk Factor App: Observational Machine Learning Study

Interpersonal Mindfulness Questionnaire: Scale Development and Validation

Measuring Everyday Creativity: A Rasch Model Analysis of the Biographical Inventory of Creative Behaviors (BICB) Scale

Iterative Item Selection of Neighborhood Clusters: A Nonparametric and Non-IRT Method for Generating Miniature Computer Adaptive Questionnaires

Workplace Mindfulness: Multidimensional Model, Scale Development and Validation