Abstract:The proportion of individuals with depression has rapidly increased along with the growth of the global population. Depression has been the currently most prevalent mental health disorder. An effective depression recognition system is especially crucial for the early detection of potential depression risk. A depression-related dataset is also critical while evaluating the system for depression or potential depression risk detection. Due to the sensitive nature of clinical data, availability and scale of such datasets are scarce. To our knowledge, there are few extensively practical depression datasets for the Chinese population. In this study, we first create a large-scale dataset by asking subjects to perform five mood-elicitation tasks. After each task, subjects' audio and video are collected, including 3D information (depth information) of facial expressions via a Kinect. The constructed dataset is from a real environment, i.e., several psychiatric hospitals, and has a specific scale. Then we propose a novel approach for potential depression risk recognition based on two kinds of different deep belief network (DBN) models. One model extracts 2D appearance features from facial images collected by an optical camera, while the other model extracts 3D dynamic features from 3D facial points collected by a Kinect. The final decision result comes from the combination of the two models. Finally, we evaluate all proposed deep models on our built dataset. The experimental results demonstrate that (1) our proposed method is able to identify patients with potential depression risk; (2) the recognition performance of combined 2D and 3D features model outperforms using either 2D or 3D features model only; (3) the performance of depression recognition is higher in the positive and negative emotional stimulus, and females' recognition rate is generally higher than that for males. Meanwhile, we compare the performance with other methods on the same dataset. The experimental results show that our integrated 2D and 3D features DBN is more reasonable and universal than other methods, and the experimental paradigm designed for depression is reasonable and practical.

Depression Recognition Based on Deep Learning Using RR Intervals

DISTINGUISHING BIPOLAR DEPRESSION FROM MAJOR DEPRESSIVE DISORDER USING FNIRS AND DEEP NEURAL NETWORK

An Intra- and Inter-Emotion Transformer-Based Fusion Model with Homogeneous and Diverse Constraints Using Multi-Emotional Audiovisual Features for Depression Detection.

EEG-Based Depression Recognition Using Convolutional Neural Network with FFT and EMD

Brain Functional Residual Temporal Convolution Network for Major Depressive Disorder Recognition

SAD-TIME: a Spatiotemporal-fused network for depression detection with Automated multi-scale Depth-wise and TIME-interval-related common feature extractor

FacialPulse: An Efficient RNN-based Depression Detection via Temporal Facial Landmarks

Depression Detection Based on the Temporal-Spatial-frequency Feature Fusion of EEG

EEG-Based Depression Recognition Using Time-Frequency Convolutional Networks.

DCTNet: hybrid deep neural network-based EEG signal for detecting depression

Automated Rest EEG-Based Diagnosis of Depression and Schizophrenia Using a Deep Convolutional Neural Network

AMGCN-L: an adaptive multi-time-window graph convolutional network with long-short-term memory for depression detection

fNIRS-Driven Depression Recognition Based on Cross-Modal Data Augmentation

A Depression Diagnosis Method Based on the Hybrid Neural Network and Attention Mechanism.

TCEDN: A Lightweight Time-Context Enhanced Depression Detection Network

Deep Neural Networks for Depression Recognition Based on 2D and 3D Facial Expressions Under Emotional Stimulus Tasks

Explainable Depression Recognition from EEG Signals via Graph Convolutional Network

A Deep Learning Approach for Mild Depression Recognition Based on Functional Connectivity Using Electroencephalography

Depression Assessment Method: An EEG Emotion Recognition Framework Based on Spatiotemporal Neural Network

Automatic Diagnosis of Depression Based on Facial Expression Information and Deep Convolutional Neural Network

EEG-based high-performance depression state recognition