Abstract:Background: Clinical notes contain contextualized information beyond structured data related to patients' past and current health status. Objective: This study aimed to design a multimodal deep learning approach to improve the evaluation precision of hospital outcomes for heart failure (HF) using admission clinical notes and easily collected tabular data. Methods: Data for the development and validation of the multimodal model were retrospectively derived from 3 open-access US databases, including the Medical Information Mart for Intensive Care III v1.4 (MIMIC-III) and MIMIC-IV v1.0, collected from a teaching hospital from 2001 to 2019, and the eICU Collaborative Research Database v1.2, collected from 208 hospitals from 2014 to 2015. The study cohorts consisted of all patients with critical HF. The clinical notes, including chief complaint, history of present illness, physical examination, medical history, and admission medication, as well as clinical variables recorded in electronic health records, were analyzed. We developed a deep learning mortality prediction model for in-hospital patients, which underwent complete internal, prospective, and external evaluation. The Integrated Gradients and SHapley Additive exPlanations (SHAP) methods were used to analyze the importance of risk factors. Results: The study included 9989 (16.4%) patients in the development set, 2497 (14.1%) patients in the internal validation set, 1896 (18.3%) in the prospective validation set, and 7432 (15%) patients in the external validation set. The area under the receiver operating characteristic curve of the models was 0.838 (95% CI 0.827-0.851), 0.849 (95% CI 0.841-0.856), and 0.767 (95% CI 0.762-0.772), for the internal, prospective, and external validation sets, respectively. The area under the receiver operating characteristic curve of the multimodal model outperformed that of the unimodal models in all test sets, and tabular data contributed to higher discrimination. The medical history and physical examination were more useful than other factors in early assessments. Conclusions: The multimodal deep learning model for combining admission notes and clinical tabular data showed promising efficacy as a potentially novel method in evaluating the risk of mortality in patients with HF, providing more accurate and timely decision support.

Empirical investigation of multi-source cross-validation in clinical ECG classification

Empirical investigation of multi-source cross-validation in clinical ECG classification

Empirical investigation of multi-source cross-validation in clinical machine learning

Cross-modal multiscale multi-instance learning for long-term ECG classification

Development and validation of machine learning algorithms based on electrocardiograms for cardiovascular diagnoses at the population level

Impact of train/test sample regimen on performance estimate stability of machine learning in cardiovascular imaging

Practical Lessons on 12-Lead ECG Classification: Meta-Analysis of Methods From PhysioNet/Computing in Cardiology Challenge 2020

Semi-Supervised Learning for Multi-Label Cardiovascular Diseases Prediction:A Multi-Dataset Study

Learning with incomplete labels of multisource datasets for ECG classification

ECG-CL: A Comprehensive Electrocardiogram Interpretation Method Based on Continual Learning

Decoding 2.3 million ECGs: interpretable deep learning for advancing cardiovascular diagnosis and mortality risk stratification

Large-scale cross-modality pretrained model enhances cardiovascular state estimation and cardiomyopathy detection from electrocardiograms: An AI system development and multi-center validation study

Machine Learning-Based Automatic Cardiovascular Disease Diagnosis Using Two ECG Leads

Open-world electrocardiogram classification via domain knowledge-driven contrastive learning

Impact of the Choice of Cross-Validation Techniques on the Results of Machine Learning-Based Diagnostic Applications

SIM-ECG: A Signal Importance Mask-driven ECGClassification System

Improving ECG Classification Interpretability using Saliency Maps

Improving the Prognostic Evaluation Precision of Hospital Outcomes for Heart Failure Using Admission Notes and Clinical Tabular Data: Multimodal Deep Learning Model

Multi-center retrospective cohort study applying deep learning to electrocardiograms to identify left heart valvular dysfunction

IMLE-Net: An Interpretable Multi-level Multi-channel Model for ECG Classification

A Multi-Task Group Bi-LSTM Networks Application on Electrocardiogram Classification