Abstract:Background: Patients with cancer starting systemic treatment programs, such as chemotherapy, often develop depression. A prediction model may assist physicians and health care workers in the early identification of these vulnerable patients. Objective: This study aimed to develop a prediction model for depression risk within the first month of cancer treatment. Methods: We included 16,159 patients diagnosed with cancer starting chemo- or radiotherapy treatment between 2008 and 2021. Machine learning models (eg, least absolute shrinkage and selection operator [LASSO] logistic regression) and natural language processing models (Bidirectional Encoder Representations from Transformers [BERT]) were used to develop multimodal prediction models using both electronic health record data and unstructured text (patient emails and clinician notes). Model performance was assessed in an independent test set (n=5387, 33%) using area under the receiver operating characteristic curve (AUROC), calibration curves, and decision curve analysis to assess initial clinical impact use. Results: Among 16,159 patients, 437 (2.7%) received a depression diagnosis within the first month of treatment. The LASSO logistic regression models based on the structured data (AUROC 0.74, 95% CI 0.71-0.78) and structured data with email classification scores (AUROC 0.74, 95% CI 0.71-0.78) had the best discriminative performance. The BERT models based on clinician notes and structured data with email classification scores had AUROCs around 0.71. The logistic regression model based on email classification scores alone performed poorly (AUROC 0.54, 95% CI 0.52-0.56), and the model based solely on clinician notes had the worst performance (AUROC 0.50, 95% CI 0.49-0.52). Calibration was good for the logistic regression models, whereas the BERT models produced overly extreme risk estimates even after recalibration. There was a small range of decision thresholds for which the best-performing model showed promising clinical effectiveness use. The risks were underestimated for female and Black patients. Conclusions: The results demonstrated the potential and limitations of machine learning and multimodal models for predicting depression risk in patients with cancer. Future research is needed to further validate these models, refine the outcome label and predictors related to mental health, and address biases across subgroups.

Predicting first time depression onset in pregnancy: applying machine learning methods to patient-reported data

Using Electronic Health Records and Machine Learning to Predict Postpartum Depression.

Development and validation of a machine learning algorithm for predicting the risk of postpartum depression among pregnant women

Depression Prediction using Machine Learning Algorithms

Prediction of adolescent depression from prenatal and childhood data from ALSPAC using machine learning

Machine Learning Methods for Predicting Postpartum Depression: Scoping Review

Machine Learning-Based Predictive Modeling of Postpartum Depression

Early Prediction of High Risk Gestational Diabetes Mellitus <i>via</i> Machine Learning Models

Predicting Prenatal Depression and Assessing Model Bias Using Machine Learning Models

Using Machine Learning to Predict Antidepressant Treatment Outcome from Electronic Health Records

Digital phenotyping of depression during pregnancy using self-report data

Development and validation of a machine learning‐based postpartum depression prediction model: A nationwide cohort study

Early Prediction of Hypertensive Disorders of Pregnancy Using Machine Learning and Medical Records from the First and Second Trimesters

Early Prediction of Gestational Diabetes Mellitus in the Chinese Population Via Advanced Machine Learning

Subphenotyping Depression Using Machine Learning and Electronic Health Records

Prediction of chromosomal abnormalities in the screening of the first trimester of pregnancy using machine learning methods: a study protocol

Machine learning techniques for predicting depression and anxiety in pregnant and postpartum women during the COVID-19 pandemic: a cross-sectional regional study

Machine Learning on Early Diagnosis of Depression

Postpartum depression prediction through pregnancy data analysis for emotion-aware smart systems

Predicting adolescent depression and anxiety from multi-wave longitudinal data using machine learning

Predicting Depression Risk in Patients With Cancer Using Multimodal Data: Algorithm Development Study