Abstract:Electronic Health Record (EHR) is the digital form of patient visits containing various medical data, including diagnosis, treatment, and lab events. Representation learning of EHR with deep learning methods has been beneficial for patient-related prediction tasks. Recently, studies have focused on revealing the inherent graph structure between medical events in EHR. Graph neural network (GNN) methods are prevalent and perform well in various prediction tasks. However, the inherent relationships between various medical events must be marked, which is complicated and time-consuming. Most research works adopt the straightforward structure of GNN models on a single prediction task which could not fully exploit the potential of EHR representations. Compared with previous work, the multi-task prediction could utilize the latent information of concealed correlations between different prediction tasks. In addition, self-contrastive learning on graphs could improve the representation learned by GNN. We propose a multi-gate mixture of multi-view graph contrastive learning (MMMGCL) method, aiming to get a more reasonable EHR representation and improve the performances of downstream tasks. First, each patient visit is represented as a graph with a well-designed hierarchically fully-connected pattern. Second, node features in the manually constructed graph are pre-trained via the Glove method with hierarchical ontology knowledge. Finally, MMMGCL processes the pre-trained graph and adopts a joint learning strategy to simultaneously optimize task and contrastive losses. We verify our method on two large open-source medical datasets, Medical Information Mart for Intensive Care (MIMIC-III) and the eICU Collaborative Research Database (eICU). Experiment results show that our method could improve performance compared to straightforward graph-based methods on prediction tasks of patient readmission, mortality, and length of stay.

Graph and text multi-modal representation learning with momentum distillation on Electronic Health Records

An Image-enhanced Molecular Graph Representation Learning Framework

Graph-Text Multi-Modal Pre-training for Medical Representation Learning

Multi-gate Mixture of Multi-view Graph Contrastive Learning on Electronic Health Record

Multi-task Heterogeneous Graph Learning on Electronic Health Records

Global Contrastive Training for Multimodal Electronic Health Records with Language Supervision

Multimodal Data Matters: Language Model Pre-Training Over Structured and Unstructured Electronic Health Records

Contrastive Learning on Multimodal Analysis of Electronic Health Records

REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models

Temporal Cross-Attention for Dynamic Embedding and Tokenization of Multimodal Electronic Health Records

How to Leverage Multimodal EHR Data for Better Medical Predictions?

Two heads are better than one: Enhancing medical representations by pre-training over structured and unstructured electronic health records

MM-GTUNets: Unified Multi-Modal Graph Deep Learning for Brain Disorders Prediction

De-biased Multimodal Electrocardiogram Analysis

Learning Missing Modal Electronic Health Records with Unified Multi-modal Data Embedding and Modality-Aware Attention

Gradient modulated contrastive distillation of low-rank multi-modal knowledge for disease diagnosis

Multimodal risk prediction with physiological signals, medical images and clinical notes

Multimodal Clinical Pseudo-notes for Emergency Department Prediction Tasks using Multiple Embedding Model for EHR (MEME)

Graph learning with label attention and hyperbolic embedding for temporal event prediction in healthcare

Large language models enabled multiagent ensemble method for efficient EHR data labeling

Research on Multimodal Fusion of Temporal Electronic Medical Records