Abstract:Background: Patient representation learning aims to learn features, also called representations, from input sources automatically, often in an unsupervised manner, for use in predictive models. This obviates the need for cumbersome, time- and resource-intensive manual feature engineering, especially from unstructured data such as text, images, or graphs. Most previous techniques have used neural network-based autoencoders to learn patient representations, primarily from clinical notes in electronic medical records (EMRs). Knowledge graphs (KGs), with clinical entities as nodes and their relations as edges, can be extracted automatically from biomedical literature and provide complementary information to EMR data that have been found to provide valuable predictive signals. Objective: This study aims to evaluate the efficacy of collective matrix factorization (CMF), both the classical variant and a recent neural architecture called deep CMF (DCMF), in integrating heterogeneous data sources from EMR and KG to obtain patient representations for clinical decision support tasks. Methods: Using a recent formulation for obtaining graph representations through matrix factorization within the context of CMF, we infused auxiliary information during patient representation learning. We also extended the DCMF architecture to create a task-specific end-to-end model that learns to simultaneously find effective patient representations and predictions. We compared the efficacy of such a model to that of first learning unsupervised representations and then independently learning a predictive model. We evaluated patient representation learning using CMF-based methods and autoencoders for 2 clinical decision support tasks on a large EMR data set. Results: Our experiments show that DCMF provides a seamless way for integrating multiple sources of data to obtain patient representations, both in unsupervised and supervised settings. Its performance in single-source settings is comparable with that of previous autoencoder-based representation learning methods. When DCMF is used to obtain representations from a combination of EMR and KG, where most previous autoencoder-based methods cannot be used directly, its performance is superior to that of previous nonneural methods for CMF. Infusing information from KGs into patient representations using DCMF was found to improve downstream predictive performance. Conclusions: Our experiments indicate that DCMF is a versatile model that can be used to obtain representations from single and multiple data sources and combine information from EMR data and KGs. Furthermore, DCMF can be used to learn representations in both supervised and unsupervised settings. Thus, DCMF offers an effective way of integrating heterogeneous data sources and infusing auxiliary knowledge into patient representations.

Phenotyping using Structured Collective Matrix Factorization of Multi--source EHR Data

Identifiable Phenotyping using Constrained Non-Negative Matrix Factorization

Physician-Centered EHR Data Utilization: A Pilot Study.

Toward Cross‐platform Electronic Health Record‐driven Phenotyping Using Clinical Quality Language

MixEHR-Guided: A guided multi-modal topic modeling approach for large-scale automatic phenotyping using the electronic health record

A Modular Architecture for Electronic Health Record-Driven Phenotyping

Constrained tensor factorization for computational phenotyping and mortality prediction in patients with cancer

A framework for employing longitudinally collected multicenter electronic health records to stratify heterogeneous patient populations on disease history

Enabling scalable clinical interpretation of ML-based phenotypes using real world data

PheME: A deep ensemble framework for improving phenotype prediction from multi-modal data

TASTE: Temporal and Static Tensor Factorization for Phenotyping Electronic Health Records

Language-model-based patient embedding using electronic health records facilitates phenotyping, disease forecasting, and progression analysis

Feature Extraction for Phenotyping from Semantic and Knowledge Resources

Design and Validation of a FHIR-based EHR-driven Phenotyping Toolbox

Patient Representation Learning From Heterogeneous Data Sources and Knowledge Graphs Using Deep Collective Matrix Factorization: Evaluation Study

Mining Primary Care Electronic Health Records for Automatic Disease Phenotyping: A Transparent Machine Learning Framework.

sEHR-CE: Language modelling of structured EHR data for efficient and generalizable patient cohort expansion

Visualization of Emergency Department Clinical Data for Interpretable Patient Phenotyping

Federated Tensor Factorization for Computational Phenotyping

Privacy-Preserving Tensor Factorization for Collaborative Health Data Analysis

Deep representation learning of electronic health records to unlock patient stratification at scale