Abstract:Background The 2019 novel coronavirus (COVID-19)-related depression symptoms of healthcare workers have received worldwide recognition. Although many studies identified risk exposures associated with depression symptoms among healthcare workers, few have focused on a predictive model using machine learning methods. As a society, governments, and organizations are concerned about the need for immediate interventions and alert systems for healthcare workers who are mentally at-risk. This study aims to develop and validate machine learning-based models for predicting depression symptoms using survey data collected during the COVID-19 outbreak in China. Method Surveys were conducted of 2,574 healthcare workers in hospitals designated to care for COVID-19 patients between 20 January and 11 February 2020. The patient health questionnaire (PHQ)-9 was used to measure the depression symptoms and quantify the severity, a score of ≥5 on the PHQ-9 represented depression symptoms positive, respectively. Four machine learning approaches were trained (75% of data) and tested (25% of data). Cross-validation with 100 repetitions was applied to the training dataset for hyperparameter tuning. Finally, all models were compared to evaluate their predictive performances and screening utility: decision tree, logistics regression with least absolute shrinkage and selection operator (LASSO), random forest, and gradient-boosting tree. Results Important risk predictors identified and ranked by the machine learning models were highly consistent: self-perceived health status factors always occupied the top five most important predictors, followed by worried about infection, working on the frontline, a very high level of uncertainty, having received any form of psychological support material and having COVID-19-like symptoms. The area under the curve [95% CI] of machine learning models were as follows: LASSO model, 0.824 [0.792–0.856]; random forest, 0.828 [0.797–0.859]; gradient-boosting tree, 0.829 [0.798–0.861]; and decision tree, 0.785 [0.752–0.819]. The calibration plot indicated that the LASSO model, random forest, and gradient-boosting tree fit the data well. Decision curve analysis showed that all models obtained net benefits for predicting depression symptoms. Conclusions This study shows that machine learning prediction models are suitable for making predictions about mentally at-risk healthcare workers predictions in a public health emergency setting. The application of multidimensional machine learning models could support hospitals' and healthcare workers' decision-making on possible psychological interventions and proper mental health management.

Prediction of comorbid anxiety and depression using machine learning models in cancer survivors

Predicting Depression, Anxiety, and Their Comorbidity among Patients with Breast Cancer in China Using Machine Learning: A Multisite Cross‐Sectional Study

Association Between Anxiety, Depression, And Comorbid Chronic Diseases Among Cancer Survivors

Using machine learning approach to predict depression and anxiety among patients with epilepsy in China: A cross-sectional study

Predicting Depression Risk in Patients With Cancer Using Multimodal Data: Algorithm Development Study

Developing a visual model for predicting depression in patients with lung cancer

Machine Learning-Based Prediction Models for Depression Symptoms Among Chinese Healthcare Workers During the Early COVID-19 Outbreak in 2020: A Cross-Sectional Study

Factors influencing psychological distress among breast cancer survivors using machine learning techniques

Advancing Depression Risk Assessment in Connective Tissue Diseases: A Multi- Classification Machine Learning Approach

Identifying the Predictors of Severe Psychological Distress by Auto-Machine Learning Methods

Machine learning-based prediction of composite risk of cardiovascular events in patients with stable angina pectoris combined with coronary heart disease: development and validation of a clinical prediction model for Chinese patients

A case for the use of deep learning algorithms for individual and population level assessments of mental health disorders: Predicting depression among China's elderly

Development and evaluation of a risk predictive model for high level of self-reported symptom cluster dis-tress in breast cancer patients undergoing chemotherapy

Risk prediction models of depression in older adults with chronic diseases

Development and Validation of a Predictive Model for Coronary Artery Disease Using Machine Learning

Construction of a machine learning-based risk prediction model for depression in middle-aged and elderly hypertensive people in China: a longitudinal study

Classification of high-risk depressed mood groups in cancer patients based on Health Ecology Model

Risk Prediction Model for Non-Suicidal Self-Injury in Chinese Adolescents with Major Depressive Disorder Based on Machine Learning

Development of a prediction model for suicidal ideation in patients with advanced cancer: A multicenter, real‐world, pan‐cancer study in China

Risk factors for high CAD-RADS scoring in CAD patients revealed by machine learning methods: a retrospective study

Predictive Models for Suicide Attempts in Major Depressive Disorder and the Contribution of EPHX2: A Pilot Integrative Machine Learning Study