Abstract:Background Psychosis poses substantial social and healthcare burdens. The analysis of speech is a promising approach for the diagnosis and monitoring of psychosis, capturing symptoms like thought disorder and flattened affect. Recent advancements in Natural Language Processing (NLP) methodologies enable the automated extraction of informative speech features, which has been leveraged for early psychosis detection and assessment of symptomology. However, critical gaps persist, including the absence of standardized sample collection protocols, small sample sizes, and a lack of multi-illness classification, limiting clinical applicability. Our study aimed to (1) identify an optimal assessment approach for the online and remote collection of speech, in the context of assessing the psychosis spectrum and evaluate whether a fully automated, speech-based machine learning (ML) pipeline can discriminate among different conditions on the schizophrenia-bipolar spectrum (SSD-BD-SPE), help-seeking comparison subjects (MDD), and healthy controls (HC) at varying layers of analysis and diagnostic complexity. Methods: We adopted online data collection methods to collect 20 minutes of speech and demographic information from individuals. Participants were categorized as healthy help-seekers (HC), having a schizophrenia-spectrum disorder (SSD), bipolar disorder (BD), major depressive disorder (MDD), or being on the psychosis spectrum with sub-clinical psychotic experiences (SPE). SPE status was determined based on self-reported clinical diagnosis and responses to the PHQ-8 and PQ-16 screening questionnaires, while other diagnoses were determined based on self-report from participants. Linguistic and paralinguistic features were extracted and ensemble learning algorithms (e.g., XGBoost) were used to train models. A 70%-30% train-test split and 30-fold cross-validation was used to validate the model performance. Results: The final analysis sample included 1140 individuals and 22,650 minutes of speech. Using 5 minutes of speech, our model could discriminate between HC and those with a serious mental illness (SSD or BD) with 86% accuracy (AUC = 0.91, Recall = 0.7, Precision = 0.98). Furthermore, our model could discern among HC, SPE, BD and SSD groups with 86% accuracy (F1 macro = 0.855, Recall Macro = 0.86, Precision Macro = 0.86). Finally, in a 5-class discrimination task including individuals with MDD, our model had 76% accuracy (F1 macro = 0.757, Recall Macro = 0.758, Precision Macro = 0.766). Conclusion: Our ML pipeline demonstrated disorder-specific learning, achieving excellent or good accuracy across several classification tasks. We demonstrated that the screening of mental disorders is possible via a fully automated, remote speech assessment pipeline. We tested our model on relatively high number conditions (5 classes) in the literature and in a stratified sample of psychosis spectrum, including HC, SPE, SSD and BD (4 classes). We tested our model on a large sample (N = 1150) and demonstrated best-in-class accuracy with remotely collected speech data in the psychosis spectrum, however, further clinical validation is needed to test the reliability of model performance.

Speech-based recognition and estimating severity of PTSD using machine learning

Speech‐based markers for posttraumatic stress disorder in US veterans

Automatic Assessment of Depression from Speech Via a Hierarchical Attention Transfer Network and Attention Autoencoders

A deep transfer learning approach for improved post-traumatic stress disorder diagnosis

Interdisciplinary approach to identify language markers for post-traumatic stress disorder using machine learning and deep learning

Multimodal Imaging-Based Classification of PTSD Using Data-Driven Computational Approaches: A Multisite Big Data Study from the ENIGMA-PGC PTSD Consortium

The application of machine learning techniques in posttraumatic stress disorder: a systematic review and meta-analysis

Application of machine learning techniques in the diagnostic approach of PTSD using MRI neuroimaging data: A systematic review

Volumetric Integrated Classification Index: an Integrated Voxel-Based Morphometry and Machine Learning Interpretable Biomarker for Post-Traumatic Stress Disorder

Machine learning methods to discriminate posttraumatic stress disorder: A protocol of systematic review and meta-analysis

Detecting Presence of PTSD Using Sentiment Analysis From Text Data

Machine learning for post‐traumatic stress disorder identification utilizing resting‐state functional magnetic resonance imaging

Speech-Based Automatic Recognition Technology For Major Depression Disorder

Predicting PTSD symptoms in firefighters using a fear-potentiated startle paradigm and machine learning

Machine-learning-based classification between post-traumatic stress disorder and major depressive disorder using P300 features

Detecting schizophrenia, bipolar disorder, psychosis vulnerability and major depressive disorder from 5 minutes of online-collected speech

Multimodal MRI-Based Classification of Trauma Survivors with and Without Post-Traumatic Stress Disorder

Utilization of machine learning for prediction of post-traumatic stress: a re-examination of cortisol in the prediction and pathways to non-remitting PTSD

Machine learning multivariate pattern analysis predicts classification of posttraumatic stress disorder and its dissociative subtype: a multimodal neuroimaging approach.

Intensive longitudinal assessment following index trauma to predict development of PTSD using machine learning

Towards predicting PTSD symptom severity using portable EEG-derived biomarkers