Abstract:Depression, a prevalent and debilitating mental health disorder, necessitates early detection to enable effective intervention. Functional Near-Infrared Spectroscopy (fNIRS) has proven to be a promising technique for studying depressive symptoms due to its affordability, portability, high spatial resolution and non-invasiveness. However, existing fNIRS-based depression detection approaches often overlook signal intrinsic properties and intrinsic correlations among different feature types, as well as local spatial geometric structures of data. To overcome these limitations, we suggest a spatio-temporal scale information fusion framework that involves supervised local low-rank correlation (IFLRC) to detect depression. IFLRC incorporates a low-rank constraint, a sparse l2,1 -norm term, multiple Laplacian regularizations, and a sparse penalty projection matrix to capture global spatial functional information, handle errors to enhance robustness to noise, preserve local spatial geometric structures, exploit correlations among multiple information sets, and enhance discriminative ability. An iterative algorithm, based on the alternating direction method of multipliers (ADMM), has been developed to solve the suggested objective function. The experimental findings validate the efficacy of IFLRC, yielding favourable detection rates of 95.8%, 87.3%, and 97.2% in response to positive, neutral, and negative emotional stimuli, respectively. These findings exceed existing methods, demonstrating the potential of fNIRS and the effectiveness of IFLRC for detecting depression. IFLRC presents notable advancements in feature extraction and fusion techniques for depression detection. Its capacity to capture spatio-temporal scale information, leverage intrinsic correlations, and preserve local geometric structures translates into improved performance. This framework holds promise for early detection and intervention in depressive disorders, offering valuable insights for clinical applications.

IIFDD: Intra and inter-modal fusion for depression detection with multi-modal information from Internet of Medical Things

An Intra- and Inter-Emotion Transformer-Based Fusion Model with Homogeneous and Diverse Constraints Using Multi-Emotional Audiovisual Features for Depression Detection.

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

Multi-Modal and Multi-Task Depression Detection with Sentiment Assistance

Multimodal Depression Detection: Fusion of Electroencephalography and Paralinguistic Behaviors Using a Novel Strategy for Classifier Ensemble.

Fusing Multi-Level Features from Audio and Contextual Sentence Embedding from Text for Interview-Based Depression Detection

Multi-modal Depression Estimation based on Sub-attentional Fusion

Attention-Based Acoustic Feature Fusion Network for Depression Detection

Enhancing Multimodal Depression Detection with Intra- and Inter-Sample Contrastive Learning

Spatio-temporal scale information fusion of functional near-infrared spectroscopy signal for depression detection

Multimodal Depression Detection Using a Deep Feature Fusion Network

MMPF: Multimodal Purification Fusion for Automatic Depression Detection

Depression Diagnosis and Analysis via Multimodal Multi-order Factor Fusion

Multimodal Sensing for Depression Risk Detection: Integrating Audio, Video, and Text Data

A Depression Detection Method Based on Multi-Modal Feature Fusion Using Cross-Attention

Multi Fine-Grained Fusion Network for Depression Detection

Image Encoding and Fusion of Multi-modal Data Enhance Depression Diagnosis in Parkinson's Disease Patients

A Multi-modal Feature Layer Fusion Model for Assessment of Depression Based on Attention Mechanisms

Making the Implicit Explicit: Depression Detection in Web across Posted Texts and Images.

A Multimodal Approach for Detection and Assessment of Depression Using Text, Audio and Video

Multi-Modal Adaptive Fusion Transformer Network for the Estimation of Depression Level