Abstract:Introduction: To assist mental health care providers with the assessment of depression, research to develop a standardized, accessible, and non-invasive technique has garnered considerable attention. Our study focuses on the application of deep learning models for automatic assessment of depression severity based on clinical interview transcriptions. Despite the recent success of deep learning, the lack of large-scale high-quality datasets is a major performance bottleneck for many mental health applications. Methods: A novel approach is proposed to address the data scarcity problem for depression assessment. It leverages both pretrained large language models and parameter-efficient tuning techniques. The approach is built upon adapting a small set of tunable parameters, known as prefix vectors, to guide a pretrained model towards predicting the Patient Health Questionnaire (PHQ)-8 score of a person. Experiments were conducted on the Distress Analysis Interview Corpus - Wizard of Oz (DAIC-WOZ) benchmark dataset with 189 subjects, partitioned into training, development, and test sets. Model learning was done on the training set. Prediction performance mean and standard deviation of each model, with five randomly-initialized runs, were reported on the development set. Finally, optimized models were evaluated on the test set. Results: The proposed model with prefix vectors outperformed all previously published methods, including models which utilized multiple types of data modalities, and achieved the best reported performance on the test set of DAIC-WOZ with a root mean square error of 4.67 and a mean absolute error of 3.80 on the PHQ-8 scale. Compared to conventionally fine-tuned baseline models, prefix-enhanced models were less prone to overfitting by using far fewer training parameters (<6% relatively). Discussion: While transfer learning through pretrained large language models can provide a good starting point for downstream learning, prefix vectors can further adapt the pretrained models effectively to the depression assessment task by only adjusting a small number of parameters. The improvement is in part due to the fine-grain flexibility of prefix vector size in adjusting the model's learning capacity. Our results provide evidence that prefix-tuning can be a useful approach in developing tools for automatic depression assessment.

Multilevel depression status detection based on fine-grained prompt learning

Multi-Modal and Multi-Task Depression Detection with Sentiment Assistance

Automatic Assessment of Depression from Speech Via a Hierarchical Attention Transfer Network and Attention Autoencoders

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

Hierarchical Attention Transfer Networks for Depression Assessment from Speech

A Multimodal Approach for Detection and Assessment of Depression Using Text, Audio and Video

A Topic-Attentive Transformer-based Model For Multimodal Depression Detection

Automatic depression severity assessment with deep learning using parameter-efficient tuning

Textual-dominated Multimodal Depression Detection

Depression Detection on Social Media with Large Language Models

Text-based Depression Detection: What Triggers an Alert

Multimodal Depression Detection Network Based on Emotional and Behavioral Features in Conversations

Automatic Depression Detection via Learning and Fusing Features from Visual Cues

Multi Fine-Grained Fusion Network for Depression Detection

MMPF: Multimodal Purification Fusion for Automatic Depression Detection

A Depression Detection Method Based on Multi-Modal Feature Fusion Using Cross-Attention

Detecting depression tendency based on deep learning and multi-sources data

Uncertainty-Aware Label Contrastive Distribution Learning for Automatic Depression Detection

Multimodal Sensing for Depression Risk Detection: Integrating Audio, Video, and Text Data

Attention guided learnable time-domain filterbanks for speech depression detection

HCAG: A Hierarchical Context-Aware Graph Attention Model for Depression Detection