Abstract:Background: Mood disorders and depression are pervasive and significant problems worldwide. These represent severe health and emotional impairments for individuals and a considerable economic and social burden. Therefore, fast and reliable diagnosis and appropriate treatment are of great importance. Verbal communication can clarify the speaker's mental state—regardless of the content, via speech melody, intonation, and so on. In both everyday life and clinical conditions, a listener with appropriate previous knowledge or a trained specialist can grasp helpful knowledge about the speaker's psychological state. Using automated speech analysis for the assessment and tracking of patients with mental health issues opens up the possibility of remote, automatic, and ongoing evaluation when used with patients' smartphones, as part of the current trends toward the increasing use of digital and mobile health tools. Objective: The primary aim of this study is to evaluate the measurements of the presence or absence of depressive mood in participants by comparing the analysis of noncontentual speech parameters with the results of the Patient Health Questionnaire-9. Methods: This proof-of-concept study included participants in different affective phases (with and without depression). The inclusion criteria included a neurological or psychiatric diagnosis made by a specialist and fluent use of the German language. The measuring instrument was the VoiceSense digital voice analysis tool, which enables the analysis of 200 specific speech parameters based on machine learning and the assessment of the findings using Patient Health Questionnaire-9. Results: A total of 292 psychiatric and voice assessments were performed with 163 participants (males: n=47, 28.8%) aged 15 to 82 years. Of the 163 participants, 87 (53.3%) were not depressed at the time of assessment, and 88 (53.9%) participants had clinically mild to moderate depressive phases. Of the 163 participants, 98 (32.5%) showed subsyndromal symptoms, and 19 (11.7%) participants were severely depressed. In the speech analysis, a clear differentiation between the individual depressive levels, as seen in the Patient Health Questionnaire-9, was also shown, especially the clear differentiation between nondepressed and depressed participants. The study showed a Pearson correlation of 0.41 between clinical assessment and noncontentual speech analysis ( P <.001). Conclusions: The use of speech analysis shows a high level of accuracy, not only in terms of the general recognition of a clinically relevant depressive state in the participants. Instead, there is a high degree of agreement regarding the extent of depressive impairment with the assessment of experienced clinical practitioners. From our point of view, the application of the noncontentual analysis system in everyday clinical practice makes sense, especially with the idea of a quick and unproblematic assessment of the state of mind, which can even be carried out without personal contact. Trial Registration: ClinicalTrials.gov NCT03700008; https://clinicaltrials.gov/ct2/show/NCT03700008

Decoding emotions: Exploring the validity of sentiment analysis in psychotherapy

Validation and application of the Non-Verbal Behavior Analyzer: An automated tool to assess non-verbal emotional expressions in psychotherapy

Machine Learning Facial Emotion Classifiers in Psychotherapy Research: A Proof-of-Concept Study

Computer-aided psychotherapy based on multimodal elicitation, estimation and regulation of emotion

Machine learning for the recognition of emotion in the speech of couples in psychotherapy using the Stanford Suppes Brain Lab Psychotherapy Dataset

Examining a sentiment algorithm on session patient records in an eating disorder treatment setting: a preliminary study

NLP meets psychotherapy: Using predicted client emotions and self-reported client emotions to measure emotional coherence

Emotional expression in psychiatric conditions: New technology for clinicians

Objectively Quantifying Pediatric Psychiatric Severity Using Artificial Intelligence, Voice Recognition Technology, and Universal Emotions: Pilot Study for Artificial Intelligence-Enabled Innovation to Address Youth Mental Health Crisis

"You made me feel this way": Investigating Partners' Influence in Predicting Emotions in Couples' Conflict Interactions using Speech Data

Learning Word Ratings for Empathy and Distress from Document-Level User Responses

Emotional tone in clinical high risk for psychosis: novel insights from a natural language analysis approach

Physiological and neural synchrony in emotional and neutral stimulus processing: A study protocol

Language or rating scales based classifications of emotions: computational analysis of language and alexithymia

Emotional Context Effects on the Rating of Ambiguous Facial Expressions in Depression and Schizophrenia Spectrum Disorders

Sentiment analysis of clinical narratives: A scoping review

Linguistic markers of anxiety and depression in Somatic Symptom and Related Disorders: Observational study of a digital intervention

Digital Content-Free Speech Analysis Tool to Measure Affective Distress in Mental Health: Evaluation Study

Improving Computer Assisted Speech Therapy Through Speech Based Emotion Recognition

Lexical use in emotional autobiographical narratives of persons with schizophrenia and healthy controls

Distinguishing Clinical Sentiment: The Importance of Domain Adaptation in Psychiatric Patient Health Records