Abstract:Selecting a course of treatment in psychiatry remains a trial-and-error process, and this long-standing clinical challenge has prompted an increased focus on predictive models of treatment response using machine learning techniques. Electroencephalography (EEG) represents a cost-effective and scalable potential measure to predict treatment response to major depressive disorder. We performed separate meta-analyses to determine the ability of models to distinguish between responders and non-responders using EEG across treatments, as well as a performed subgroup analysis of response to transcranial magnetic stimulation (rTMS), and antidepressants (Registration Number: CRD42021257477) in Major Depressive Disorder by searching PubMed, Scopus, and Web of Science for articles published between January 1960 and February 2022. We included 15 studies that predicted treatment responses among patients with major depressive disorder using machine-learning techniques. Within a random-effects model with a restricted maximum likelihood estimator comprising 758 patients, the pooled accuracy across studies was 83.93% (95% CI: 78.90–89.29), with an Area-Under-the-Curve (AUC) of 0.850 (95% CI: 0.747–0.890), and partial AUC of 0.779. The average sensitivity and specificity across models were 77.96% (95% CI: 60.05–88.70), and 84.60% (95% CI: 67.89–92.39), respectively. In a subgroup analysis, greater performance was observed in predicting response to rTMS (Pooled accuracy: 85.70% (95% CI: 77.45–94.83), Area-Under-the-Curve (AUC): 0.928, partial AUC: 0.844), relative to antidepressants (Pooled accuracy: 81.41% (95% CI: 77.45–94.83, AUC: 0.895, pAUC: 0.821). Furthermore, across all meta-analyses, the specificity (true negatives) of EEG models was greater than the sensitivity (true positives), suggesting that EEG models thus far better identify non-responders than responders to treatment in MDD. Studies varied widely in important features across models, although relevant features included absolute and relative power in frontal and temporal electrodes, measures of connectivity, and asymmetry across hemispheres. Predictive models of treatment response using EEG hold promise in major depressive disorder, although there is a need for prospective model validation in independent datasets, and a greater emphasis on replicating physiological markers. Crucially, standardization in cut-off values and clinical scales for defining clinical response and non-response will aid in the reproducibility of findings and the clinical utility of predictive models. Furthermore, several models thus far have used data from open-label trials with small sample sizes and evaluated performance in the absence of training and testing sets, which increases the risk of statistical overfitting. Large consortium studies are required to establish predictive signatures of treatment response using EEG, and better elucidate the replicability of specific markers. Additionally, it is speculated that greater performance was observed in rTMS models, since EEG is assessing neural networks more likely to be directly targeted by rTMS, comprising electrical activity primarily near the surface of the cortex. Prospectively, there is a need for models that examine the comparative effectiveness of multiple treatments across the same patients. However, this will require a thoughtful consideration towards cumulative treatment effects, and whether washout periods between treatments should be utilised. Regardless, longitudinal cross-over trials comparing multiple treatments across the same group of patients will be an important prerequisite step to both facilitate precision psychiatry and identify generalizable physiological predictors of response between and across treatment options.

Can we predict who will benefit from cognitive-behavioural therapy? A systematic review and meta-analysis of machine learning studies

What the future holds: Machine learning to predict success in psychotherapy

Methodological choices and clinical usefulness for machine learning predictions of outcome in Internet-based cognitive behavioural therapy

Machine learning in the prediction of depression treatment outcomes: a systematic review and meta-analysis

The promise of machine learning in predicting treatment outcomes in psychiatry

Predicting remission following CBT for childhood anxiety disorders: a machine learning approach

Predicting therapy outcome in a digital mental health intervention for depression and anxiety: A machine learning approach

Data-driven personalized medicine approaches to cognitive-behavioral therapy allocation in a large sample: A reanalysis of the ENRICHED study

Machine Learning in Electroconvulsive Therapy: A Systematic Review

Machine Learning in Electroconvulsive Therapy

Predicting treatment response using EEG in major depressive disorder: A machine-learning meta-analysis

Neural predictors of treatment response to brain stimulation and psychological therapy in depression: a double-blind randomized controlled trial

Predicting Treatment Outcome Based on Resting-State Functional Connectivity in Internalizing Mental Disorders: A Systematic Review and Meta-Analysis

Electroencephalography for predicting antidepressant treatment success: A systematic review and meta-analysis

Cross-trial prediction of depression remission using problem-solving therapy: A machine learning approach

Predicting long-term outcome of Internet-delivered cognitive behavior therapy for social anxiety disorder using fMRI and support vector machine learning

A Machine Learning Approach to Understanding Patterns of Engagement With Internet-Delivered Mental Health Interventions

Lack of evidence for predictive utility from resting state fMRI data for individual exposure-based cognitive behavioral therapy outcomes: A machine learning study in two large multi-site samples in anxiety disorders

Cognitive Behavioural Therapy for Depression, Panic Disorder and Generalized Anxiety Disorder: A Meta-Regression of Factors that May Predict Outcome

Towards a neuroimaging biomarker for predicting cognitive behavioural therapy outcomes in treatment-naive depression: preliminary findings

Development and Validation of a Deep-Learning Model for Differential Treatment Benefit Prediction for Adults with Major Depressive Disorder Deployed in the Artificial Intelligence in Depression Medication Enhancement (AIDME) Study