Abstract:Introduction Late Life Depression (LLD) is characterized by low remission rates using currently available treatments. Therefore, it is crucial for clinicians to have personalized tools to better identify older adults who may have a greater chance of success when deciding on a given treatment. In particular, psychotherapy is an important and under-utilized treatment option for older adults who may not tolerate medications or have drug interactions that limit pharmacotherapy. In this study, we aimed to use machine-learning methods to identify pre-treatment characteristics that are predictive of psychotherapy treatment success (i.e. Depression Remission after psychotherapy treatment). Methods We analyzed data from a previously described 12-week trial of weekly Problem Solving Therapy (PST) in 96 participants with Major Depressive Disorder who were 65 years or older (Kassel et al. 2022). Using machine-learning methods, we examined 20 pre-treatment characteristics of interest across four categories: 1) Demographic Factors, 2) Depression History, 3) Depression Symptom Characteristics, and 4) Cognitive Test Scores. The Gradient Boosted Method (GBM) was used to determine the relative importance of each characteristic as a possible predictor, which guided development of specific, short (depth=3) Decision Tree models to predict Depression Remission (17-item Hamilton Depression Score < 7). Given sample size limitations, these models were trained on the same sample to which they were applied for prediction. Results Three Decision Tree models were significant at the p<0.001 threshold: Age and Depression History, pre-treatment Episodic Memory Function, and All 20 Pre-treatment Characteristics Available (the resulting optimal model only utilized 5 of the 20 characteristics across the 4 categories of available pre-treatment characteristics). Amongst the three significant models: Classification Accuracy was 73.6-77.4% and AUC was 0.763-0.789. These 3 models offered high Specificity (82.8-95.1%) and Negative Predictive Value (75.3-82.8%) and relatively lower Sensitivity (34.5-63.3%) and Positive Predictive Value (61.5-76.9%). Age and Depression History (See Figure 1) was the simplest of the three significant models with only five Leaves (i.e. Terminal Nodes). In contrast, models derived from the pre-treatment Cognitive Domains of Executive Function, Processing Speed, and Language Function were each not significantly predictive of Depression Remission at the p<0.001 threshold. Models derived from pre-treatment Depression Symptom Characteristics were also not significantly predictive at this threshold. Conclusions We have derived an Age and Depression History Decision Tree model (Figure 1) that would only require assessment of 3 simple pre-treatment characteristics to improve prediction of psychotherapy success: correctly classifying about three quarters of the participants in our sample. The pre-treatment Episodic Memory Function Decision Tree model had a similar classification rate but does require cognitive testing. Both models were superior to models derived only from other Cognitive Domains, including models of Executive Function. However, validation of these models is needed and will require testing their predictive value in larger, more representative samples. These results demonstrate a novel machine-learning based prediction strategy that is simple for clinicians to use and thus may hold promise in personalizing difficult treatment decisions for LLD.

Generalized linear mixed-model (GLMM) trees: A flexible decision-tree method for multilevel and longitudinal data

Detecting treatment-subgroup interactions in clustered data with generalized linear mixed-effects model trees

Subgroup detection in linear growth curve models with generalized linear mixed model (GLMM) trees

Finding structure in data using multivariate tree boosting

Subgroup identification in clinical trials: an overview of available methods and their implementations with R

Regression Trees for Longitudinal Data

Hierarchical multinomial processing tree models for meta-analysis of diagnostic accuracy studies

metboost: Exploratory regression analysis with hierarchically clustered data

Using Targeted Maximum Likelihood Estimation to Estimate Treatment Effect with Longitudinal Continuous or Binary Data: A Systematic Evaluation of 28 Diabetes Clinical Trials

Developing Clinically Relevant Decision Tree Models Using Machine-Learning to Predict Psychotherapy Success in Late Life Depression

Analysis of a longitudinal multilevel experiment using GAMLSSs

A Regression Tree Method for Longitudinal and Clustered Data with Multivariate Responses

Efficient penalized generalized linear mixed models for variable selection and genetic risk prediction in high-dimensional data

Longitudinal Modeling of Age-Dependent Latent Traits with Generalized Additive Latent and Mixed Models

Using Multilevel Models and Generalized Estimating Equation Models to Account for Clustering in Neurology Clinical Research

Modeling Heterogeneity and Missing Data of Multiple Longitudinal Outcomes in Electronic Health Records

Integrating decision modeling and machine learning to inform treatment stratification

Decision making and uncertainty quantification for individualized treatments using Bayesian Additive Regression Trees

Growth mixture models: a case example of the longitudinal analysis of patient-reported outcomes data captured by a clinical registry

Identifying differential responders and their characteristics in clinical trials: innovative methods for analyzing longitudinal data

MedDM:LLM-executable clinical guidance tree for clinical decision-making