Toward Generalizable and Transdiagnostic Tools for Psychosis Prediction: An Independent Validation and Improvement of the NAPLS-2 Risk Calculator in the Multisite PRONIA Cohort
Nikolaos Koutsouleris,Michelle Worthington,Lana Kambeitz-Ilankovic,Rachele Sanfelici,Paolo Fusar-Poli,Marlene Rosen,Stephan Ruhrmann,Alan Anticevic,Jean Addington,Thomas McGlashan,Larry Seidman,Ming Tsuang,Peter Falkai,Rebekka Lencer,Alessandro Bertolino,Joseph Kambeitz,Frauke Schultze-Lutter,Eva Meisenzahl,Jarmo Hietala,Paolo Brambilla,Rachel Upthegrove,Stefan Borgwardt,Stephen Wood,Philip McGuire,Dominic B. Dwyer,Diana O. Perkins,Carrie E. Bearden,Barbara A. Cornblatt,Kristin S. Cadenhead,Daniel H. Mathalon,Elaine F. Walker,Scott W. Woods,Raimo K.R. Salokangas,Raquel E. Gur,Tyrone D. Cannon
DOI: https://doi.org/10.1016/j.biopsych.2021.06.023
IF: 12.81
2021-11-01
Biological Psychiatry
Abstract:BackgroundTransition to psychosis is among the most adverse outcomes of the clinical high-risk (CHR) syndromes encompassing ultra-high-risk (UHR) and basic symptoms states. Clinical risk calculators may facilitate an early and individualized interception of psychosis, but their real-world implementation requires thorough validation across diverse risk populations, including young patients with depressive syndromes.MethodsWe validated the previously described NAPLS-2 calculator in 334 patients (26 with psychosis transition) with CHR or recent-onset depression (ROD) drawn from the multisite European PRONIA study. Patients were categorized into three risk enrichment levels, ranging from UHR, over CHR, to a broad risk population comprising CHR or ROD patients (CHR|ROD). We assessed how risk enrichment and different predictive algorithms influenced prognostic performance using reciprocal external validation.ResultsAfter calibration, the NAPLS-2 model predicted psychosis with a balanced accuracy [BAC(sensitivity,specificity)] of 68%(73%,63%) in the PRONIA-UHR, 67%(74%,60%) in CHR, and 70%(73%,66%) in CHR|ROD patients. Multiple model derivation in PRONIA-CHR|ROD and validation in NAPLS-2-UHR patients confirmed that broader risk definitions produced more accurate risk calculators [CHR|ROD-based vs. UHR-based performance: 67%(68%,66%) vs. 58%(61%,56%)]. Support-vector machines (SVM) were superior in CHR|ROD (BAC=71%), while ridge logistic regression and SVM performed similarly in CHR (BAC=67%) and UHR cohorts (BAC=65%). Attenuated psychotic symptoms predicted psychosis across risk levels, while younger age and reduced processing speed became increasingly relevant for broader risk cohorts.ConclusionsClinical-neurocognitive machine-learning models operating in young patients with affective and CHR syndromes facilitate a more precise and generalizable prediction of psychosis. Future studies should investigate their therapeutic utility in large-scale clinical trials.
neurosciences,psychiatry