Abstract:Depression is increasingly impacting individuals both physically and psychologically worldwide. It has become a global major public health problem and attracts attention from various research fields. Traditionally, the diagnosis of depression is formulated through semi-structured interviews and supplementary questionnaires, which makes the diagnosis heavily relying on physicians experience and is subject to bias. Mental health monitoring and cloud-based remote diagnosis can be implemented through an automated depression diagnosis system. In this article, we propose an attention-based multimodality speech and text representation for depression prediction. Our model is trained to estimate the depression severity of participants using the Distress Analysis Interview Corpus-Wizard of Oz (DAIC-WOZ) dataset. For the audio modality, we use the collaborative voice analysis repository (COVAREP) features provided by the dataset and employ a Bidirectional Long Short-Term Memory Network (Bi-LSTM) followed by a Time-distributed Convolutional Neural Network (T-CNN). For the text modality, we use global vectors for word representation (GloVe) to perform word embeddings and the embeddings are fed into the Bi-LSTM network. Results show that both audio and text models perform well on the depression severity estimation task, with best sequence level F1 score of 0.9870 and patient-level F1 score of 0.9074 for the audio model over five classes (healthy, mild, moderate, moderately severe, and severe), as well as sequence level F1 score of 0.9709 and patient-level F1 score of 0.9245 for the text model over five classes. Results are similar for the multimodality fused model, with the highest F1 score of 0.9580 on the patient-level depression detection task over five classes. Experiments show statistically significant improvements over previous works.

Towards Automatic Depression Detection: A BiLSTM/1D CNN-Based Model

Automatic Assessment of Depression from Speech Via a Hierarchical Attention Transfer Network and Attention Autoencoders

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

Hybrid Network Feature Extraction for Depression Assessment from Speech

Prediction of Depression Severity Based on the Prosodic and Semantic Features with Bidirectional LSTM and Time Distributed CNN

Automatic Depression Recognition by Intelligent Speech Signal Processing: A Systematic Survey

Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Model

A Multimodal Approach for Detection and Assessment of Depression Using Text, Audio and Video

Detecting Depression from Speech Through an Attentive LSTM Network

Speech-Based Automatic Recognition Technology For Major Depression Disorder

An hybrid deep learning approach for depression prediction from user tweets using feature-rich CNN and bi-directional LSTM

Prediction of Depression Severity Based on Transformer Encoder and CNN Model

Automatic diagnosis of depression based on attention mechanism and feature pyramid model

Multi-Head Attention-Based Long Short-Term Memory for Depression Detection From Speech

A Deep Learning Method on Audio and Text Sequences for Automatic Depression Detection

Automated depression analysis using convolutional neural networks from speech

Attention-Based Acoustic Feature Fusion Network for Depression Detection

Depression Detection in Speech Using Transformer and Parallel Convolutional Neural Networks

Automatic Diagnosis of Depression Based on Facial Expression Information and Deep Convolutional Neural Network

Bidirectional LSTM and Attention for Depression Detection on Clinical Interview Transcripts

A deep learning-based model for detecting depression in senior population