Abstract:The use of Electronic Health Records (EHR) for translational research can be challenging due to difficulty in extracting accurate disease phenotype data. Historically, EHR algorithms for annotating phenotypes have been either rule-based or trained with billing codes and gold standard labels curated via labor intensive medical chart review. These simplistic algorithms tend to have unpredictable portability across institutions and low accuracy for many disease phenotypes due to imprecise billing codes. Recently, more sophisticated machine learning algorithms have been developed to improve the robustness and accuracy of EHR phenotyping algorithms. These algorithms are typically trained via supervised learning, relating gold standard labels to a wide range of candidate features including billing codes, procedure codes, medication prescriptions and relevant clinical concepts extracted from narrative notes via Natural Language Processing (NLP). However, due to the time intensiveness of gold standard labeling, the size of the training set is often insufficient to build a generalizable algorithm with the large number of candidate features extracted from EHR. To reduce the number of candidate predictors and in turn improve model performance, we present an automated feature selection method based entirely on unlabeled observations. The proposed method generates a comprehensive surrogate for the underlying phenotype with an unsupervised clustering of disease status based on several highly predictive features such as diagnosis codes and mentions of the disease in text fields available in the entire set of EHR data. A sparse regression model is then built with the estimated outcomes and remaining covariates to identify those features most informative of the phenotype of interest. Relying on the results of Li and Duan (1989), we demonstrate that variable selection for the underlying phenotype model can be achieved by fitting the surrogate-based model. We explore the performance of our methods in numerical simulations and present the results of a prediction model for Rheumatoid Arthritis (RA) built on a large EHR data mart from the Partners Health System consisting of billing codes and NLP terms. Empirical results suggest that our procedure reduces the number of gold-standard labels necessary for phenotyping thereby harnessing the automated power of EHR data and improving efficiency.

RAM-EHR: Retrieval Augmentation Meets Clinical Predictions on Electronic Health Records

EMERGE: Integrating RAG for Improved Multimodal EHR Predictive Modeling

EHR-ML: A generalisable pipeline for reproducible clinical outcomes using electronic health records

RAMDS: Retrieval Augmented Medical Diagnosis System for Explainable Breast Cancer Classification from Ultrasound Images

Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records

BEHRT: Transformer for Electronic Health Records

Enhanced Electronic Health Records Text Summarization Using Large Language Models

Scalable and accurate deep learning with electronic health records

REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models

MEGACare: Knowledge-guided multi-view hypergraph predictive framework for healthcare

Query-Focused EHR Summarization to Aid Imaging Diagnosis

Fine-tuning pre-trained extractive QA models for clinical document parsing

EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records

Question-Answering Based Summarization of Electronic Health Records using Retrieval Augmented Generation

Predicting Risk of Alzheimer's Diseases and Related Dementias with AI Foundation Model on Electronic Health Records

Reasoning-Enhanced Healthcare Predictions with Knowledge Graph Community Retrieval

EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Records

Automated feature selection of predictors in electronic medical records data

A pre-trained language model for emergency department intervention prediction using routine physiological data and clinical narratives

Endpoint prediction of heart failure using electronic health records

Emergency Department Decision Support using Clinical Pseudo-notes