Abstract:Background: Major depressive disorder is a common mental disorder affecting 5% of adults worldwide. Early contact with health care services is critical for achieving accurate diagnosis and improving patient outcomes. Key symptoms of major depressive disorder (depression hereafter) such as cognitive distortions are observed in verbal communication, which can also manifest in the structure of written language. Thus, the automatic analysis of text outputs may provide opportunities for early intervention in settings where written communication is rich and regular, such as social media and web-based forums. Objective: The objective of this study was 2-fold. We sought to gauge the effectiveness of different machine learning approaches to identify users of the mass web-based forum Reddit, who eventually disclose a diagnosis of depression. We then aimed to determine whether the time between a forum post and a depression diagnosis date was a relevant factor in performing this detection. Methods: A total of 2 Reddit data sets containing posts belonging to users with and without a history of depression diagnosis were obtained. The intersection of these data sets provided users with an estimated date of depression diagnosis. This derived data set was used as an input for several machine learning classifiers, including transformer-based language models (LMs). Results: Bidirectional Encoder Representations from Transformers (BERT) and MentalBERT transformer-based LMs proved the most effective in distinguishing forum users with a known depression diagnosis from those without. They each obtained a mean F1-score of 0.64 across the experimental setups used for binary classification. The results also suggested that the final 12 to 16 weeks (about 3-4 months) of posts before a depressed user's estimated diagnosis date are the most indicative of their illness, with data before that period not helping the models detect more accurately. Furthermore, in the 4- to 8-week period before the user's estimated diagnosis date, their posts exhibited more negative sentiment than any other 4-week period in their post history. Conclusions: Transformer-based LMs may be used on data from web-based social media forums to identify users at risk for psychiatric conditions such as depression. Language features picked up by these classifiers might predate depression onset by weeks to months, enabling proactive mental health care interventions to support those at risk for this condition.

Behavioral Activation and Depression Symptomatology: Longitudinal Assessment of Linguistic Indicators in Text-Based Therapy Sessions

Linguistic markers of anxiety and depression in Somatic Symptom and Related Disorders: Observational study of a digital intervention

Linguistic style as a digital marker for depression severity: An ambulatory assessment pilot study in patients with depressive disorder undergoing sleep deprivation therapy

Behavioral Activation as a Principle-Based Treatment: Developments from a Multi-Site Collaboration to Advance Adolescent Depression Treatment

Examining a Fully Automated Mobile-Based Behavioral Activation Intervention in Depression: Randomized Controlled Trial

Language sentiment predicts changes in depressive symptoms

Linguistic Analysis of Communication in Therapist-Assisted Internet-Delivered Cognitive Behavior Therapy for Generalized Anxiety Disorder

The relationship between linguistic expression and symptoms of depression, anxiety, and suicidal thoughts: A longitudinal study of blog content

Language Analytics for Assessment of Mental Health Status and Functional Competency

Prospective associations of text‐message‐based sentiment with symptoms of depression, generalized anxiety, and social anxiety

Linguistic markers for major depressive disorder: a cross-sectional study using an automated procedure

Components of Behavioral Activation Therapy for Depression Engage Specific Reinforcement Learning Mechanisms in a Pilot Study

Language and Mental Health: Measures of Emotion Dynamics from Text as Linguistic Biosocial Markers

Enabling Early Health Care Intervention by Detecting Depression in Users of Web-Based Forums using Language Models: Longitudinal Analysis and Evaluation

ALBA: Adaptive Language-based Assessments for Mental Health

A comprehensive review of behavioral activation treatment for depression

Predicting Efficacy of Internet-Based Cognitive Behavioral Therapy for Depression Through Speech Acoustic Analysis: A Machine Learning Approach (Preprint)

Self-guided behavioral activation using an online single-session intervention: Content and lexical analyses of activity scheduling

Evaluating the Efficacy of AI-Based Interactive Assessments Using Large Language Models for Depression Screening

A Narrative Review of Empirical Literature of Behavioral Activation Treatment for Depression

Individual behavioral activation in the treatment of depression: A meta analysis