Abstract:BACKGROUND:At present, no tools exist to estimate objectively the risk of poor treatment outcomes in patients with first-episode psychosis. Such tools could improve treatment by informing clinical decision-making before the commencement of treatment. We tested whether such a tool could be successfully built and validated using routinely available, patient-reportable information. METHODS:By applying machine learning to data from 334 patients in the European First Episode Schizophrenia Trial (EUFEST; International Clinical Trials Registry Platform number, ISRCTN68736636), we developed a tool to predict poor versus good treatment outcome (Global Assessment of Functioning [GAF] score ≥65 vs GAF <65, respectively) after 4 weeks and 52 weeks of treatment. To enable the unbiased estimation of the predictive system's generalisability to new patients, we used repeated nested cross-validation to prevent information leaking between patients used for training and validating the models. In pursuit of everyday clinical applicability, we retrained the 4-week outcome predictor with only the top ten predictors of the pooled prediction system and then tested this tool in 108 independent patients with 4-week outcome labels. Discontinuation and readmission to hospital events in patients with predicted poor versus good outcomes were assessed with Kaplan-Meier log-rank analyses, whereas generalised linear mixed-effects models were used to investigate the GAF-based predictions against several clinically meaningful outcome indicators, including treatment adherence, symptom remission, and quality of life. FINDINGS:The generalisability of our outcome predictions were estimated with cross-validation (test-fold balanced accuracy [BAC] of 75·0% for 4-week outcomes and 73·8% for and 52-week outcomes), and leave-site-out validation across 44 European sites (BAC of 72·1% for 4-week outcomes and 71·1% for 52-week outcomes). We identified a smaller group of ten predictors still providing a BAC of 71·7% in 108 patients never used for model discovery. Unemployment, poor education, functional deficits, and unmet psychosocial needs predicted both endpoints, whereas previous depressive episodes, male sex, and suicidality additionally predicted poor 1-year outcomes. 52-week predictions identified patients at risk for symptom persistence, non-adherence to treatment, readmission to hospital and poor quality of life. Specifically among these patients, amisulpride and olanzapine showed superior efficacy versus haloperidol, quetiapine, and ziprasidone. INTERPRETATION:Our results suggest that prognostic models operating on brief, patient-reportable pre-treatment data might provide useful insight into individualised outcome trajectories, optimising treatment selection, and targeted clinical trial designs. To embed these tools into real-world care, replication is needed in external first-episode samples with overlapping variables, which are not available in the field at present. FUNDING:The European Group for Research in Schizophrenia.

Predicting treatment resistance in schizophrenia patients: Machine learning highlights the role of early pathophysiologic features

A predictor model of treatment resistance in schizophrenia using data from electronic health records

Clinical predictors of antipsychotic treatment resistance: Development and internal validation of a prognostic prediction model by the STRATA-G consortium

Multisite prediction of 4-week and 52-week treatment outcomes in patients with first-episode psychosis: a machine learning approach

A machine-learning framework for robust and reliable prediction of short- and long-term treatment response in initially antipsychotic-naïve schizophrenia patients based on multimodal neuropsychiatric data

The promise of machine learning in predicting treatment outcomes in psychiatry

Efficiently identifying individuals at high risk for treatment resistance in major depressive disorder using electronic health records

Predicting diagnostic progression to schizophrenia or bipolar disorder via machine learning applied to electronic health record data

Predicting treatment resistance in positive and negative symptom domains from first episode psychosis: Development of a clinical prediction model

Machine learning for predicting psychotic relapse at 2 years in schizophrenia in the national FACE-SZ cohort

Prediction Models of Functional Outcomes for Individuals in the Clinical High-Risk State for Psychosis or With Recent-Onset Depression: A Multimodal, Multisite Machine Learning Analysis

Prediction of quality of life in schizophrenia using machine learning models on data from Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) schizophrenia trial

Contribution of socio-demographic and clinical characteristics to predict initial referrals to psychosocial interventions in patients with serious mental illness

Machine learning methods to predict outcomes of pharmacological treatment in psychosis

Predicting Treatment Response in Schizophrenia With Magnetic Resonance Imaging and Polygenic Risk Score

Structural MRI-Based Predictions in Patients with Treatment-Refractory Depression (TRD)

Development and initial evaluation of a clinical prediction model for risk of treatment resistance in first-episode psychosis: Schizophrenia Prediction of Resistance to Treatment (SPIRIT)

Neurodevelopmental predictors of treatment response in schizophrenia and bipolar disorder

Pathway-Phenotypes of Non-responders and Partial Responders to Treatment With Antipsychotics in Schizophrenia: A Machine Learning Study

Individualized multi-modal MRI biomarkers predict 1-year clinical outcome in first-episode drug-naïve schizophrenia patients

Machine Learning Prediction of Treatment Outcome in Late-Life Depression