Abstract:Depression is a serious mental disorder, significantly burdens individuals, families, and society. For clinical psychiatrists, assessing the severity of depression is a crucial tool in selecting treatment approaches and evaluating their effectiveness. Although many studies in machine learning have focused on the automatic evaluation of self-rating scales [such as the Beck Depression Inventory-II (BDI-II) and the Patient Health Questionnaire-8 (PHQ-8)], research into the machine learning-based automatic evaluation of the medical clinical assessment scale [such as the Hamilton Depression Scale (HAMD)] has not yet been focused on. In this study, an end-to-end automatic evaluation device for HAMD and Patient Health Questionnaire-9 (PHQ-9) scores was developed. In addition, we constructed a dataset consisting of emotional facial expression videos (eFEVs) signals and emotional pupil-wave (ePW) signals from 65 patients with depression. The dataset has HAMD and PHQ-9 score labels, encompassing two emotional states: sadness and happiness. We built a 3-dimensional convolutional neural network + long short-term memory (3DCNN + LSTM) model framework and a multiscale 1-dimensional convolutional neural network (1DCNN) to learn and extract features from eFEVs and ePW automatically. The results showed that compared with the previous evaluation methods for depression levels, the evaluation precision of HAMD and PHQ-9 has been improved significantly. The results also showed that, in both HAMD and PHQ-9 evaluations, the evaluation precision of eFEVs was superior to ePW, and HAMD is better than PHQ-9. These studies indicated that both emotional facial expressions and ePW can better represent depressive mood in patients with depression, especially emotional facial expressions, and the predictive precision of the medical scale is significantly better than the self-rating scale. This automated assessment method and device can assist doctors in diagnosing depressive symptoms more effectively and serve as an evaluation tool for treatment efficacy.

Objective Assessment of Depression Using Multiple Physiological Signals

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

DISTINGUISHING BIPOLAR DEPRESSION FROM MAJOR DEPRESSIVE DISORDER USING FNIRS AND DEEP NEURAL NETWORK

[Resting-State Electroencephalogram Classification of Patients with Schizophrenia or Depression].

Machine Learning Techniques Reveal Aberrated Multidimensional EEG Characteristics in Patients with Depression

Automatic depression diagnosis through hybrid EEG and near-infrared spectroscopy features using support vector machine

Classifying Major Depression Patients and Healthy Controls Using EEG, Eye Tracking and Galvanic Skin Response Data

Feature-level fusion approaches based on multimodal EEG data for depression recognition

A study of resting-state EEG biomarkers for depression recognition

Depression Detection using Resting State Three-channel EEG Signal

Automatic Assessment Method and Device for Depression Symptom Severity Based on Emotional Facial Expression and Pupil-Wave

Depression recognition using resting-state and event-related fMRI signals

Effective differentiation between depressed patients and controls using discriminative eye movement features

Cross-subject classification of depression by using multiparadigm EEG feature fusion

EEG-based major depressive disorder recognition by selecting discriminative features via stochastic search

EEG-based high-performance depression state recognition

An Improved Empirical Mode Decomposition of Electroencephalogram Signals for Depression Detection

Utilization of passive visual perception task in detecting patients with major depressive disorder for active health

Mutual Information Based Fusion Model (MIBFM): Mild Depression Recognition Using EEG and Pupil Area Signals

A novel EEG-based major depressive disorder detection framework with two-stage feature selection

Multimodal Mental Health Digital Biomarker Analysis from Remote Interviews using Facial, Vocal, Linguistic, and Cardiovascular Patterns