Abstract:Background and objective: Depression can severely impact physical and mental health and may even harm society. Therefore, detecting the early symptoms of depression and treating them on time is critical. The widespread use of social media has led individuals with depressive tendencies to express their emotions on social platforms, share their painful experiences, and seek support and help. Therefore, the massive available amounts of social platform data provide the possibility of identifying depressive tendencies. Methods: This paper proposes a neural network hybrid model MTDD to achieve this goal. Analysis of the content of users' posts on social platforms has facilitated constructing a post-level method to detect depressive tendencies in individuals. Compared with existing methods, the MTDD model uses the following innovative methods: First, this model is based on social platform data, which is objective and accurate, can be obtained at a low cost, and is easy to operate. The model can avoid the influence of subjective factors in the depressive tendency detection method based on consultation with mental health experts. In other words, it can avoid the problem of undisclosed and imperfect data in depressive tendency detection. Second, the MTDD model is based on a deep neural network hybrid model, combining the advantages of CNN and BiLSTM networks and avoiding the problem of poor generalization ability in a single model for depression tendency recognition. Third, the MTDD model is based on multimodal features for learning the vector representation of depression-prone text, including text features, semantic features, and domain knowledge, making the model more robust. Results: Extensive experimental results demonstrate that our MTDD model detects users who may have a depressive tendency with a 95% F1 value and obtained SOTA results. Conclusions: Our MTDD model can detect depressive users on social media platforms more effectively, providing the possibility for early diagnosis and timely treatment of depression. The experiment proves that our MTDD model outperforms many of the latest depressive tendency detection models.

Making the Implicit Explicit: Depression Detection in Web across Posted Texts and Images.

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

An Intra- and Inter-Emotion Transformer-Based Fusion Model with Homogeneous and Diverse Constraints Using Multi-Emotional Audiovisual Features for Depression Detection.

Dynamic Facial Features in Positive-Emotional Speech for Identification of Depressive Tendencies

Enhancing depression detection: A multimodal approach with text extension and content fusion

A Depression Detection Method Based on Multi-Modal Feature Fusion Using Cross-Attention

SenseMood: Depression Detection on Social Media

A Multitask Deep Learning Approach for User Depression Detection on Sina Weibo

Cooperative Multimodal Approach to Depression Detection in Twitter

IIFDD: Intra and inter-modal fusion for depression detection with multi-modal information from Internet of Medical Things

Detecting depression tendency with multimodal features

Depression Detection Via Harvesting Social Media: A Multimodal Dictionary Learning Solution

Textual-dominated Multimodal Depression Detection

What Symptoms and How Long? An Interpretable AI Approach for Depression Detection in Social Media

An Intelligent Depression Detection Model Based On Multimodal Fusion Technology

DepMSTAT: Multimodal Spatio-Temporal Attentional Transformer for Depression Detection

Leveraging Domain Knowledge to Improve Depression Detection on Chinese Social Media

Fusing Visual, Textual and Connectivity Clues for Studying Mental Health

Text-based Decision Fusion Model for Detecting Depression

Attention-Based Acoustic Feature Fusion Network for Depression Detection

Detect Depression from Communication: How Computer Vision, Signal Processing, and Sentiment Analysis Join Forces