Abstract:Although randomized controlled trials (RCTs) are the gold standard for establishing the efficacy and safety of a medical treatment, real-world evidence (RWE) generated from real-world data has been vital in postapproval monitoring and is being promoted for the regulatory process of experimental therapies. An emerging source of real-world data is electronic health records (EHRs), which contain detailed information on patient care in both structured (eg, diagnosis codes) and unstructured (eg, clinical notes and images) forms. Despite the granularity of the data available in EHRs, the critical variables required to reliably assess the relationship between a treatment and clinical outcome are challenging to extract. To address this fundamental challenge and accelerate the reliable use of EHRs for RWE, we introduce an integrated data curation and modeling pipeline consisting of 4 modules that leverage recent advances in natural language processing, computational phenotyping, and causal modeling techniques with noisy data. Module 1 consists of techniques for data harmonization. We use natural language processing to recognize clinical variables from RCT design documents and map the extracted variables to EHR features with description matching and knowledge networks. Module 2 then develops techniques for cohort construction using advanced phenotyping algorithms to both identify patients with diseases of interest and define the treatment arms. Module 3 introduces methods for variable curation, including a list of existing tools to extract baseline variables from different sources (eg, codified, free text, and medical imaging) and end points of various types (eg, death, binary, temporal, and numerical). Finally, module 4 presents validation and robust modeling methods, and we propose a strategy to create gold-standard labels for EHR variables of interest to validate data curation quality and perform subsequent causal modeling for RWE. In addition to the workflow proposed in our pipeline, we also develop a reporting guideline for RWE that covers the necessary information to facilitate transparent reporting and reproducibility of results. Moreover, our pipeline is highly data driven, enhancing study data with a rich variety of publicly available information and knowledge sources. We also showcase our pipeline and provide guidance on the deployment of relevant tools by revisiting the emulation of the Clinical Outcomes of Surgical Therapy Study Group Trial on laparoscopy-assisted colectomy versus open colectomy in patients with early-stage colon cancer. We also draw on existing literature on EHR emulation of RCTs together with our own studies with the Mass General Brigham EHR.

Embracing Disease Progression with a Learning System for Real World Evidence Discovery.

An Electronic Medical Record System with Treatment Recommendations Based on Patient Similarity.

A Method for the Early Prediction of Chronic Diseases Based on Short Sequential Medical Data.

Harnessing electronic health records for real-world evidence

Exploratory Electronic Health Record Analysis with Ehrapy

Generate Analysis-Ready Data for Real-world Evidence: Tutorial for Harnessing Electronic Health Records With Advanced Informatic Technologies

Electronic Health Records-Based Data-Driven Diabetes Knowledge Unveiling and Risk Prognosis

Mining Patterns of Disease Progression: A Topic-Model-Based Approach.

Towards System Modelling to Support Diseases Data Extraction from the Electronic Health Records for Physicians Research Activities

Exploiting Multi-granular Features for the Enhanced Predictive Modeling of COPD Based on Chinese EMRs

Enhancing Personalized Healthcare via Capturing Disease Severity, Interaction, and Progression

Healthcare Predictive Analytics for Disease Progression: a Longitudinal Data Fusion Approach

A Transfer-Learning-Based Prognosis Prediction Paradigm That Bridges Data Distribution Shift Across EMR Datasets

Language-model-based patient embedding using electronic health records facilitates phenotyping, disease forecasting, and progression analysis

Interpretable Disease Progression Prediction Based on Reinforcement Reasoning over a Knowledge Graph

CovidCare: Transferring Knowledge from Existing EMR to Emerging Epidemic for Interpretable Prognosis

Longitudinal Cohorts for Harnessing the Electronic Health Record for Disease Prediction in a US Population.

Rare disease knowledge enrichment through a data-driven approach

On mining latent treatment patterns from electronic medical records

Identification and Progression of Heart Disease Risk Factors in Diabetic Patients from Longitudinal Electronic Health Records

Domain-invariant Clinical Representation Learning by Bridging Data Distribution Shift across EMR Datasets