Abstract:Importance: Social and occupational impairments contribute to the burden of psychosis and depression. There is a need for risk stratification tools to inform personalized functional-disability preventive strategies for individuals in at-risk and early phases of these illnesses. Objective: To determine whether predictors associated with social and role functioning can be identified in patients in clinical high-risk (CHR) states for psychosis or with recent-onset depression (ROD) using clinical, imaging-based, and combined machine learning; assess the geographic, transdiagnostic, and prognostic generalizability of machine learning and compare it with human prognostication; and explore sequential prognosis encompassing clinical and combined machine learning. Design, setting, and participants: This multisite naturalistic study followed up patients in CHR states, with ROD, and with recent-onset psychosis, and healthy control participants for 18 months in 7 academic early-recognition services in 5 European countries. Participants were recruited between February 2014 and May 2016, and data were analyzed from April 2017 to January 2018. ain outcomes and measures: Performance and generalizability of prognostic models. Results: A total of 116 individuals in CHR states (mean [SD] age, 24.0 [5.1] years; 58 [50.0%] female) and 120 patients with ROD (mean [SD] age, 26.1 [6.1] years; 65 [54.2%] female) were followed up for a mean (SD) of 329 (142) days. Machine learning predicted the 1-year social-functioning outcomes with a balanced accuracy of 76.9% of patients in CHR states and 66.2% of patients with ROD using clinical baseline data. Balanced accuracy in models using structural neuroimaging was 76.2% in patients in CHR states and 65.0% in patients with ROD, and in combined models, it was 82.7% for CHR states and 70.3% for ROD. Lower functioning before study entry was a transdiagnostic predictor. Medial prefrontal and temporo-parieto-occipital gray matter volume (GMV) reductions and cerebellar and dorsolateral prefrontal GMV increments had predictive value in the CHR group; reduced mediotemporal and increased prefrontal-perisylvian GMV had predictive value in patients with ROD. Poor prognoses were associated with increased risk of psychotic, depressive, and anxiety disorders at follow-up in patients in the CHR state but not ones with ROD. Machine learning outperformed expert prognostication. Adding neuroimaging machine learning to clinical machine learning provided a 1.9-fold increase of prognostic certainty in uncertain cases of patients in CHR states, and a 10.5-fold increase of prognostic certainty for patients with ROD. Conclusions and relevance: Precision medicine tools could augment effective therapeutic strategies aiming at the prevention of social functioning impairments in patients with CHR states or with ROD.

Illusory generalizability of clinical prediction models

The promise of machine learning in predicting treatment outcomes in psychiatry

Generalizability of Clinical Prediction Models in Mental Health - Real-World Validation of Machine Learning Models for Depressive Symptom Prediction

Predictive validity of psychosis risk models when applied to adolescent psychiatric patients

The path toward generalizable clinical prediction models

Evaluation of clinical prediction models (part 1): from development to external validation

Clinical prediction models and the multiverse of madness

Precision psychiatry: predicting predictability

Prediction of Clinical Outcomes in Psychotic Disorders Using Artificial Intelligence Methods: A Scoping Review

Machine learning methods to predict outcomes of pharmacological treatment in psychosis

Generalizability of Cardiovascular Disease Clinical Prediction Models: 158 Independent External Validations of 104 Unique Models

When accurate prediction models yield harmful self-fulfilling prophecies

AI and mental health: evaluating supervised machine learning models trained on diagnostic classifications

Prediction Models of Functional Outcomes for Individuals in the Clinical High-Risk State for Psychosis or With Recent-Onset Depression: A Multimodal, Multisite Machine Learning Analysis

Why do probabilistic clinical models fail to transport between sites

Evidence of Inflated Prediction Performance: A Commentary on Machine Learning and Suicide Research

Algorithmic fairness in precision psychiatry: analysis of prediction models in individuals at clinical high risk for psychosis

External Validation of a Machine Learning Model for Schizophrenia Classification

Why Do Probabilistic Clinical Models Fail To Transport Between Sites?

Methodological choices and clinical usefulness for machine learning predictions of outcome in Internet-based cognitive behavioural therapy