Abstract:The Canadian Journal of Psychiatry, Ahead of Print. ObjectiveIn response to high demand and prolonged wait times for cognitive behavioural therapy (CBT) in Ontario, Canada, we developed predictive models to stratify patients into high- or low-intensity treatment, aiming to optimize limited healthcare resources.MethodUsing client records (n = 953) from Ontario Shores Centre for Mental Health Sciences (January 2017–2021), we estimated four binary outcome models to assign patients into complex and standard cases based on the probability of reliable improvement in Patient Health Questionnaire-9 (PHQ-9) and Generalized Anxiety Disorder-7 (GAD-7) scores. We evaluated two choices of cut-offs for patient complexity assignment: models at an ROC (receiver operating characteristic)-derived cut-off and a 0.5 probability cut-off. Final model effectiveness was assessed by assigning treatment intensity (high-intensity or low-intensity CBT) based on the combined performance of both GAD-7 and PHQ-9 models. We compared the treatment assignment recommendations provided by the models to those assigned by clinical assessors.ResultsThe predictive models demonstrated higher accuracy in selecting treatment modality compared to provider-assigned treatment selection. The ROC cut-off achieved the highest prediction accuracy of case complexity (0.749). The predictive models exhibited large sensitivity and specificity trade-offs (which influence the rates of patient assignment to high-intensity CBT) despite having similar accuracy statistics (ROC cut-off = 0.749, 0.5 cut-off = 0.690), emphasizing the impact of cut-off choices when implementing predictive models.ConclusionsOverall, our findings suggest that the predictive model has the potential to improve the allocation of CBT services by shifting incoming clients with milder symptoms of depression to low-intensity CBT, with those at highest risk of not improving beginning in high-intensity CBT. We have demonstrated that models can have significant sensitivity and specificity trade-offs depending on the chosen acceptable threshold for the model to make positive predictions of case complexity. Further research could assess the use of the predictive model in real-world clinical settings.Plain Language Summary TitleStratified Care in Cognitive Behavioural Therapy: A Comparative Evaluation of Predictive Modeling Approaches for Individualized TreatmentPlain Language SummaryIn response to high demand and prolonged wait times for cognitive behavioral therapy (CBT) in Ontario, Canada, we developed predictive models to stratify patients into high- or low-intensity treatment, aiming to optimize limited healthcare resources.We used client records from Ontario Shores Centre for Mental Health Sciences (January 2017–2021). The final model's effectiveness was assessed by assigning treatment intensity (high-intensity or low-intensity CBT) based on treatment success. Treatment success was determined using validated symptom scales. We compared the treatment assignment recommendations provided by the predictive model to those assigned by clinical assessors. Overall, our findings suggest that the predictive model has the potential to improve the allocation of CBT services by shifting incoming clients with milder symptoms of depression to low-intensity CBT, with those at highest risk of not improving beginning in high-intensity CBT.

Predicting optimal treatment allocation for cognitive analytic‐guided self‐help versus cognitive behavioural‐guided self‐help

Comparison of outcomes across low-intensity psychological interventions for depression and anxiety within a stepped-care setting: A naturalistic cohort study using propensity score modelling

Data-driven personalized medicine approaches to cognitive-behavioral therapy allocation in a large sample: A reanalysis of the ENRICHED study

P158: Efficacy of a self-help cognitive-behavioral therapy (GSH-CBT) guided by lay providers for generalized anxiety disorder (GAD) in older adults: preliminary results

Personalized Psychotherapy for Outpatients with Major Depression and Anxiety Disorders: Transdiagnostic Versus Diagnosis-Specific Group Cognitive Behavioural Therapy

A pragmatic randomized waitlist-controlled effectiveness and cost-effectiveness trial of digital interventions for depression and anxiety

Guided self-help cognitive behavioural therapy for depression in primary care: a randomised controlled trial

Initial Evaluation of a Personalized Advantage Index to Determine Which Individuals May Benefit from Mindfulness-Based Cognitive Therapy for Suicide Prevention

Baseline Machine Learning Prediction of 2-Year Remission from Anxiety, Depression, and Eating Disorders among College Students after Population-Based Guided Self-Help: A Secondary Analysis of a Randomized Controlled Trial

The Personalized Advantage Index: Translating Research on Prediction into Individualized Treatment Recommendations. A Demonstration

Treatment histories, barriers, and preferences for individuals with symptoms of generalized anxiety disorder

Choosing the right treatment - combining clinicians' expert knowledge with data-driven predictions

Predicting which intervention works better for whom: Moderators of treatment effect of Mindfulness-Based Cognitive Therapy and Positive Psychology Intervention in patients with bipolar disorder

Can we predict who will benefit from cognitive-behavioural therapy? A systematic review and meta-analysis of machine learning studies

Cognitive Behavioural Therapy for Depression, Panic Disorder and Generalized Anxiety Disorder: A Meta-Regression of Factors that May Predict Outcome

Methodological choices and clinical usefulness for machine learning predictions of outcome in Internet-based cognitive behavioural therapy

Predicting anxiety treatment outcome in community mental health services using linked health administrative data

Identifying predictors of a favourable outcome for outpatients with a persistent depressive disorder treated with Cognitive Behavioural Analysis System of Psychotherapy: A prospective cohort study

Effectiveness and predictors of group cognitive behaviour therapy outcome for generalised anxiety disorder in an out-patient hospital setting

Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies