Abstract:Objective. Depression is a common chronic mental disorder characterized by high rates of prevalence, recurrence, suicide, and disability as well as heavy disease burden. An accurate diagnosis of depression is a prerequisite for treatment. However, existing questionnaire-based diagnostic methods are limited by the innate subjectivity of medical practitioners and subjects. In the search for a more objective diagnostic methods for depression, researchers have recently started to use deep learning approaches. Approach. In this work, a deep-learning network, named Adaptively Multi-time-window Graph Convolutional Network (GCN) with Long-short-term memory (LSTM) (i.e., AMGCN-L), is proposed. This network can automatically categorize depressed and non-depressed people by testing for the existence of inherent brain functional connectivity and spatiotemporal features contained in electroencephalogram (EEG) signals. AMGCN-L is mainly composed of two sub-networks: The first sub-network is an adaptive multi-time-window graph generation block with which adjacency matrices that contain brain functional connectivity on different time periods are adaptively designed. The second sub-network consists of GCN and LSTM, which are used to fully extract the innate spatial and temporal features of EEG signals, respectively. Main results. Two public datasets, namely the Patient Repository for EEG data and Computational Tools (PRED+CT), and the Multi-modal Open Dataset for Mental-disorder Analysis (MODMA), were used to test the performance of the proposed network; the depression recognition accuracies achieved in both datasets (using tenfold cross-validation) were 90.38% and 90.57%, respectively. Significance. This work demonstrates that GCN and LSTM have eminent effects on spatial and temporal feature extraction, respectively, suggesting that the exploration of brain connectivity and the exploitation of spatiotemporal features benefit the detection of depression. Moreover, the proposed method provides effective support and supplement for the detection of clinical depression and later treatment procedures.

DepressionMLP: A Multi-Layer Perceptron Architecture for Automatic Depression Level Prediction via Facial Keypoints and Action Units

CubeMLP: an MLP-based Model for Multimodal Sentiment Analysis and Depression Estimation

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

Dynamic Facial Features in Positive-Emotional Speech for Identification of Depressive Tendencies

Depressioner: Facial dynamic representation for automatic depression level prediction

An Intra- and Inter-Emotion Transformer-Based Fusion Model with Homogeneous and Diverse Constraints Using Multi-Emotional Audiovisual Features for Depression Detection.

Automatic Assessment of Depression from Speech Via a Hierarchical Attention Transfer Network and Attention Autoencoders

Multi-Scale and Multi-Region Facial Discriminative Representation for Automatic Depression Level Prediction.

PointTransform Networks for automatic depression level prediction via facial keypoints

FacialPulse: An Efficient RNN-based Depression Detection via Temporal Facial Landmarks

Dual Attention and Element Recalibration Networks for Automatic Depression Level Prediction

Multimodal Spatiotemporal Representation for Automatic Depression Level Detection

A Deep Multiscale Spatiotemporal Network for Assessing Depression from Facial Dynamics

Multi Fine-Grained Fusion Network for Depression Detection

Depression Detection Based on Facial Expression, Audio and Gait

AMGCN-L: an adaptive multi-time-window graph convolutional network with long-short-term memory for depression detection

Automatic diagnosis of depression based on attention mechanism and feature pyramid model

Transformer-based multimodal feature enhancement networks for multimodal depression detection integrating video, audio and remote photoplethysmograph signals

Multi Task Sequence Learning for Depression Scale Prediction from Video

Neural Architecture Searching for Facial Attributes-based Depression Recognition

Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representation