Abstract:Background: Mood disorders and depression are pervasive and significant problems worldwide. These represent severe health and emotional impairments for individuals and a considerable economic and social burden. Therefore, fast and reliable diagnosis and appropriate treatment are of great importance. Verbal communication can clarify the speaker's mental state—regardless of the content, via speech melody, intonation, and so on. In both everyday life and clinical conditions, a listener with appropriate previous knowledge or a trained specialist can grasp helpful knowledge about the speaker's psychological state. Using automated speech analysis for the assessment and tracking of patients with mental health issues opens up the possibility of remote, automatic, and ongoing evaluation when used with patients' smartphones, as part of the current trends toward the increasing use of digital and mobile health tools. Objective: The primary aim of this study is to evaluate the measurements of the presence or absence of depressive mood in participants by comparing the analysis of noncontentual speech parameters with the results of the Patient Health Questionnaire-9. Methods: This proof-of-concept study included participants in different affective phases (with and without depression). The inclusion criteria included a neurological or psychiatric diagnosis made by a specialist and fluent use of the German language. The measuring instrument was the VoiceSense digital voice analysis tool, which enables the analysis of 200 specific speech parameters based on machine learning and the assessment of the findings using Patient Health Questionnaire-9. Results: A total of 292 psychiatric and voice assessments were performed with 163 participants (males: n=47, 28.8%) aged 15 to 82 years. Of the 163 participants, 87 (53.3%) were not depressed at the time of assessment, and 88 (53.9%) participants had clinically mild to moderate depressive phases. Of the 163 participants, 98 (32.5%) showed subsyndromal symptoms, and 19 (11.7%) participants were severely depressed. In the speech analysis, a clear differentiation between the individual depressive levels, as seen in the Patient Health Questionnaire-9, was also shown, especially the clear differentiation between nondepressed and depressed participants. The study showed a Pearson correlation of 0.41 between clinical assessment and noncontentual speech analysis ( P <.001). Conclusions: The use of speech analysis shows a high level of accuracy, not only in terms of the general recognition of a clinically relevant depressive state in the participants. Instead, there is a high degree of agreement regarding the extent of depressive impairment with the assessment of experienced clinical practitioners. From our point of view, the application of the noncontentual analysis system in everyday clinical practice makes sense, especially with the idea of a quick and unproblematic assessment of the state of mind, which can even be carried out without personal contact. Trial Registration: ClinicalTrials.gov NCT03700008; https://clinicaltrials.gov/ct2/show/NCT03700008

VOCAL EMOTION RECOGNITION TEST: RELIABILITY, VALIDITY, AND CLINICAL UTILITY

Vocal Emotion Perception in Schizophrenia and Its Diagnostic Significance.

Chinese facial emotion recognition test: reliability and validity

Impairments in Negative Facial Emotion Recognition in Chinese Schizophrenia Patients Detected with A Newly Designed Task

Vocal Acoustic Features as Potential Biomarkers for Identifying/Diagnosing Depression: A Cross-Sectional Study

Virtual faces as a tool to study emotion recognition deficits in schizophrenia

[Measuring impairment of facial affects recognition in schizophrenia. Preliminary study of the facial emotions recognition task (TREF)]

Channel- and Category-Specific Emotion Recognition Deficits and Their Associations with Symptomatology and Cognition in Individuals with Schizophrenia

Improving emotion recognition in schizophrenia with "VOICES": An on-line prosodic self-training

Auditory Emotion Recognition Deficits in Schizophrenia: A Systematic Review and Meta-Analysis

Establishment and Psychometric Characteristics of Emotional Words List for Suicidal Risk Assessment in Speech Emotion Recognition

How to assess emotional recognition in individuals with a diagnosis of schizophrenia and other psychotic disorders: a pilot study

RECOGNITION OF EMOTIONS FROM VOICE IN MILD COGNITIVE IMPAIRMENT AND ALZHEIMER’S DISEASE DEMENTIA

Digital Content-Free Speech Analysis Tool to Measure Affective Distress in Mental Health: Evaluation Study

Comparisons of facial emotion recognition in different social contexts among patients with schizophrenia, major depressive disorder and bipolar disorder

Do we recognize facial expressions of emotions from persons with schizophrenia?

Validation of behavioral measures of social cognition in individuals diagnosed with schizophrenia

A Generalizable Speech Emotion Recognition Model Reveals Depression and Remission

Emotion processes in voice‐hearers: Understanding differences in emotional reactivity, emotion regulation and alexithymia

Facial Emotion Recognition Predicts Alexithymia Using Machine Learning

Interpersonal Communication Competence and Ability of Emotional Recognition among Patients with Schizophrenia