Abstract:With the current advancement in the Internet, there has been a growing demand for building intelligent and smart systems that can efficiently address the detection of health-related problems on social media, such as the detection of depression and anxiety. These types of systems, which are mainly dependent on machine learning techniques, must be able to deal with obtaining the semantic and syntactic meaning of texts posted by users on social media. The data generated by users on social media contains unstructured and unpredictable content. Several systems based on machine learning and social media platforms have recently been introduced to identify health-related problems. However, the text representation and deep learning techniques employed provide only limited information and knowledge about the different texts posted by users. This is owing to a lack of long-term dependencies between each word in the entire text and a lack of proper exploitation of recent deep learning schemes. In this paper, we propose a novel framework to efficiently and effectively identify depression and anxiety-related posts while maintaining the contextual and semantic meaning of the words used in the whole corpus when applying bidirectional encoder representations from transformers (BERT). In addition, we propose a knowledge distillation technique, which is a recent technique for transferring knowledge from a large pretrained model (BERT) to a smaller model to boost performance and accuracy. We also devised our own data collection framework from Reddit and Twitter, which are the most common social media sites. Finally, we employed word2vec and BERT with Bi-LSTM to effectively analyze and detect depression and anxiety signs from social media posts. Our system surpasses other state-of-the-art methods and achieves an accuracy of 98% using the knowledge distillation technique.

Characterization of Anxiety, Depression, and their Comorbidity from Texts of Social Networks

A Deep Learning Ensemble to Classify Anxiety, Depression, and their Comorbidity from Texts of Social Networks

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

Depression Prediction using Machine Learning Algorithms

Towards Preemptive Detection of Depression and Anxiety in Twitter

Early Detection of Depression: Social Network Analysis and Random Forest Techniques

A textual-based featuring approach for depression detection using machine learning classifiers and social media texts

Anxious Depression Prediction in Real-time Social Data

Early Depression Detection from Social Network Using Deep Learning Techniques

Psychological Analysis for Depression Detection from Social Networking Sites

Detecting Early Onset of Depression from Social Media Text using Learned Confidence Scores

DeepLearningBrasil@LT-EDI-2023: Exploring Deep Learning Techniques for Detecting Depression in Social Media Text

See and Read: Detecting Depression Symptoms in Higher Education Students Using Multimodal Social Media Data

Mental Illness Classification on Social Media Texts using Deep Learning and Transfer Learning

Exploring Hybrid and Ensemble Models for Multiclass Prediction of Mental Health Status on Social Media

An ensemble approach to detect depression from social media platform: E-CLS

Analysis of Deep Learning Techniques for Early Detection of Depression on Social Media Network - A Comparative Study

A Novel Text Mining Approach for Mental Health Prediction Using Bi-LSTM and BERT Model

Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis

Deep temporal modelling of clinical depression through social media text

Utilizing Neural Networks and Linguistic Metadata for Early Detection of Depression Indications in Text Sequences