Abstract:Background Psychosis poses substantial social and healthcare burdens. The analysis of speech is a promising approach for the diagnosis and monitoring of psychosis, capturing symptoms like thought disorder and flattened affect. Recent advancements in Natural Language Processing (NLP) methodologies enable the automated extraction of informative speech features, which has been leveraged for early psychosis detection and assessment of symptomology. However, critical gaps persist, including the absence of standardized sample collection protocols, small sample sizes, and a lack of multi-illness classification, limiting clinical applicability. Our study aimed to (1) identify an optimal assessment approach for the online and remote collection of speech, in the context of assessing the psychosis spectrum and evaluate whether a fully automated, speech-based machine learning (ML) pipeline can discriminate among different conditions on the schizophrenia-bipolar spectrum (SSD-BD-SPE), help-seeking comparison subjects (MDD), and healthy controls (HC) at varying layers of analysis and diagnostic complexity. Methods: We adopted online data collection methods to collect 20 minutes of speech and demographic information from individuals. Participants were categorized as healthy help-seekers (HC), having a schizophrenia-spectrum disorder (SSD), bipolar disorder (BD), major depressive disorder (MDD), or being on the psychosis spectrum with sub-clinical psychotic experiences (SPE). SPE status was determined based on self-reported clinical diagnosis and responses to the PHQ-8 and PQ-16 screening questionnaires, while other diagnoses were determined based on self-report from participants. Linguistic and paralinguistic features were extracted and ensemble learning algorithms (e.g., XGBoost) were used to train models. A 70%-30% train-test split and 30-fold cross-validation was used to validate the model performance. Results: The final analysis sample included 1140 individuals and 22,650 minutes of speech. Using 5 minutes of speech, our model could discriminate between HC and those with a serious mental illness (SSD or BD) with 86% accuracy (AUC = 0.91, Recall = 0.7, Precision = 0.98). Furthermore, our model could discern among HC, SPE, BD and SSD groups with 86% accuracy (F1 macro = 0.855, Recall Macro = 0.86, Precision Macro = 0.86). Finally, in a 5-class discrimination task including individuals with MDD, our model had 76% accuracy (F1 macro = 0.757, Recall Macro = 0.758, Precision Macro = 0.766). Conclusion: Our ML pipeline demonstrated disorder-specific learning, achieving excellent or good accuracy across several classification tasks. We demonstrated that the screening of mental disorders is possible via a fully automated, remote speech assessment pipeline. We tested our model on relatively high number conditions (5 classes) in the literature and in a stratified sample of psychosis spectrum, including HC, SPE, SSD and BD (4 classes). We tested our model on a large sample (N = 1150) and demonstrated best-in-class accuracy with remotely collected speech data in the psychosis spectrum, however, further clinical validation is needed to test the reliability of model performance.

Automated linguistic analysis in youth at clinical high risk for psychosis

Neuroanatomical Heterogeneity and Homogeneity in Individuals at Clinical High Risk for Psychosis

Automated analysis of speech as a marker of sub-clinical psychotic experiences

Emotional tone in clinical high risk for psychosis: novel insights from a natural language analysis approach

Association of Structural Magnetic Resonance Imaging Measures with Psychosis Onset in Individuals at Clinical High Risk for Developing Psychosis: an ENIGMA Working Group Mega-analysis.

Computational analysis of linguistic features in speech samples of first-episode bipolar disorder and psychosis

Speech based natural language profile before, during and after the onset of psychosis: A cluster analysis

Natural language processing methods are sensitive to sub-clinical linguistic differences in schizophrenia spectrum disorders

Natural language processing for defining linguistic features in schizophrenia: A sample from Turkish speakers

Natural language processing in at-risk mental states: enhancing the assessment of thought disorders and psychotic traits with semantic dynamics and graph theory

Detecting schizophrenia, bipolar disorder, psychosis vulnerability and major depressive disorder from 5 minutes of online-collected speech

Automated, Objective Speech and Language Markers of Longitudinal Changes in Psychosis Symptoms

The SPEAK study rationale and design: A linguistic corpus-based approach to understanding thought disorder

Using brain structural neuroimaging measures to predict psychosis onset for individuals at clinical high-risk

Language Analytics for Assessment of Mental Health Status and Functional Competency

Identification of distinct clinical profiles and trajectories in individuals at high risk of developing psychosis: A latent profile analysis of the north American prodrome longitudinal study consortium‐3 dataset

Speech Analysis by Natural Language Processing Techniques: A Possible Tool for Very Early Detection of Cognitive Decline?

Towards a scalable approach to assess speech organization across the psychosis-spectrum -online assessment in conjunction with automated transcription and extraction of speech measures

Clinical utility of the at-risk for psychosis state beyond transition: A multidimensional network analysis

Neuropsychological deficits in participants at clinical high risk for psychosis recruited from the community: relationships to functioning and clinical symptoms

Speech markers to predict and prevent recurrent episodes of psychosis: A narrative overview and emerging opportunities