Abstract:Background and objective Caused by shared genetic risk factors and similar neuropsychological symptoms, bipolar disorder (BD) and major depressive disorder (MDD) are at high risk of misdiagnosis, which is associated with ineffective treatment and worsening of outcomes. We aimed to develop a machine learning (ML)-based diagnostic system, based on electronic medical records (EMR) data, to mimic the clinical reasoning of human physicians to differentiate MDD and BD (especially BD depressive episodes) patients about to be admitted to a hospital and, hence, reduce the misdiagnosis of BD as MDD on admission. In addition, we examined to what extent our ML model could be made interpretable by quantifying and visualizing the features that drive the predictions. Methods By identifying 16311 patients admitted to a hospital located in western China between 2009 and 2018 with a recorded main diagnosis of MDD or BD, we established three sub-cohorts with different combinations of features for both the MDD-BD cohort and the MDD-BD depressive episodes cohort, respectively. Four different ML algorithms (logistic regression, extreme gradient boosting (XGBoost), random forest, and support vector machine) and four train-test splits were used to train and validate diagnostic models, and explainable methods (SHAP and Break Down) were utilized to analyze the contribution of each of the features at both population-level and individual-level, including feature importance, feature interaction, and feature effect on prediction decision for a specific subject. Results The XGBoost algorithm provided the best test performance (AUC: 0.838 (0.810-0.867), PPV: 0.810 and NPV: 0.834) for separating patients with BD from those with MDD. Core predictors included symptoms (mood-up, exciting, bad sleep, loss of interest, talking, mood-down, provoke), along with age, job, myocardial enzyme markers (creatine kinase, hydroxybutyrate dehydrogenase), diabetes-associated marker (glucose), bone function marker (alkaline phosphatase), non-enzymatic antioxidant (uric acid), markers of immune/inflammation (white blood cell count, lymphocyte count, basophil percentage, monocyte count), cardiovascular function marker (low density lipoprotein), renal marker (total protein), liver biochemistry marker (indirect bilirubin), and vital signs like pulse. For separating patients with BD depressive episodes from those with MDD, the test AUC was 0.777 (0.732-0.822), with PPV 0.576 and NPV 0.899. Additional validation in models built with self-reported symptoms removed from the feature set, showed test AUC of 0.701 (0.666-0.736) for differentiating BD and MDD, and AUC of 0.564 (0.515-0.614) for detecting patients in BD depressive episodes from MDD patients. Validation in the datasets without removing the patients with comorbidity showed an AUC of 0.826 (0.806-0.846). Conclusion The diagnostic system accurately identified patients with BD in various clinical scenarios, and differences in patterns of peripheral markers between BD and MDD could enrich our understanding of potential underlying pathophysiological mechanisms of them.

Reevaluating feature importances in machine learning models for schizophrenia and bipolar disorder: The need for true associations

External Validation of a Machine Learning Model for Schizophrenia Classification

AI and mental health: evaluating supervised machine learning models trained on diagnostic classifications

The challenges of using machine learning models in psychiatric research and clinical practice

Mitigating biases in feature selection and importance assessments in predictive models using LASSO regression

Diagnosis of Schizophrenia: A comprehensive evaluation

A Comparative Machine Learning Study of Connectivity-Based Biomarkers of Schizophrenia

The Effect of Acute Stress on the Interpretability and Generalization of Schizophrenia Predictive Machine Learning Models

Machine learning for prediction of schizophrenia based on identifying the primary and interaction effects of minor physical anomalies

Machine learning techniques in diagnostics and prediction of the clinical features of schizophrenia: a narrative review

Machine Learning Technique Reveals Intrinsic Characteristics of Schizophrenia: an Alternative Method

Using machine learning to understand social isolation and loneliness in schizophrenia, bipolar disorder, and the community

A critical reappraisal of predicting suicidal ideation using fMRI

Machine learning applied to the prediction of relapse, hospitalization, and suicide in bipolar disorder using neuroimaging and clinical data: A systematic review

Systematic misestimation of machine learning performance in neuroimaging studies of depression

Role of different omics data in the diagnosis of schizophrenia disorder: A machine learning study

Machine‐based learning of multidimensional data in bipolar disorder – pilot results

Explainable machine-learning algorithms to differentiate bipolar disorder from major depressive disorder using self-reported symptoms, vital signs, and blood-based markers

Unveiling the potential of machine learning in schizophrenia diagnosis: A meta-analytic study of task-based neuroimaging data

Single-label machine learning classification revealed some hidden but inter-related causes of five psychotic disorder diseases

Illusory generalizability of clinical prediction models