Abstract:Importance: The use of real-world data (RWD) external control arms in prospective studies is increasing. The advantages, including the immediate availability of a control population, must be balanced with the requirements of meeting evidentiary standards. Objective: To address the question of whether and to what extent the methods of RWD studies compare to standard methods used in randomized clinical trials. Evidence review: A systematic search across 4 electronic databases and Google Scholar was conducted from January 1, 2000, to October 23, 2023. Studies were included in the systematic review if they compared an intervention arm in a clinical trial to an RWD control arm in patients with hematological cancers and if they were published between 2000 and 2023. Findings: Thirty-two prospective intervention studies incorporating external control data from RWD sources of patients with hematological cancers were identified. A total of 4306 patients from intervention arms and 10 594 from RWD control arms were included across all studies. Only 2 studies (6%) included prospectively collected RWD. The complete trial inclusion criteria were applied to the RWD cohort in 7 studies (22%). Four studies (13%) published the statistical analysis plan and prespecified use of RWD. A total of 23 studies (72%) applied matching algorithms for trial and RWD cohorts, including matching for demographic, disease, and/or therapy-related characteristics. The end point criteria were the same as the trial in 8 studies (25%). In contrast, 12 studies (38%) used different end points, and 12 (38%) did not provide an end point definition for the RWD. Twelve studies (38%) had a median follow-up difference of less than a year between arms. Eight studies (25%) reported toxic effect data for the trial arm, of which 5 studies reported toxic effect data for the RWD arm. Conclusions and relevance: In this systematic review, limitations were observed in the application of clinical trial eligibility criteria to RWD, statistical rigor and application of matching methods, the definition of end points, follow-up, and reporting of adverse events, which may challenge the conclusions reported in studies using RWD.

Externally Controlled Studies Using Real-World Data in Patients With Hematological Cancers

Externally Controlled Studies Using Real-World Data in Patients With Hematological Cancers: A Systematic Review

Real-World Data and Evidence in Lung Cancer: A Review of Recent Developments

Reality check: Real-world evidence to support therapeutic development in hematologic malignancies

Evaluation of Real-World Tumor Response Derived From Electronic Health Record Data Sources: A Feasibility Analysis in Patients With Metastatic Non-Small Cell Lung Cancer Treated With Chemotherapy

How comparable are patient outcomes in the "real-world" with populations studied in pivotal AML trials?

Exploring the discrepancies between clinical trials and real-world data by accounting for Selection criteria, Operations, and Measurements of Outcome

Harnessing the Potential of Real-World Evidence in the Treatment of Colorectal Cancer: Where Do We Stand?

Research in haematological cancers: What do patients in the Netherlands prioritise?

Validation of Real-World Data-based Endpoint Measures of Cancer Treatment Outcomes.

Simulating Colorectal Cancer Trials Using Real-World Data.

A Review and Comparative Case Study Analysis of Real-World Evidence in European Regulatory and Health Technology Assessment Decision Making for Oncology Medicines

Real-world outcomes associated with new cancer medicines approved by the Food and Drug Administration and European Medicines Agency: A retrospective cohort study

<i>Implementing Real-World RECIST-based Tumor Response Assessment in Patients With Metastatic Non-small Cell Lung Cancer</i> Comment

An Electronic Health Record Text Mining Tool to Collect Real‐World Drug Treatment Outcomes: A Validation Study in Patients With Metastatic Renal Cell Carcinoma

Patient-Reported Outcomes in Phase 3 Clinical Trials for Blood Cancers

Real-World Evidence Gathering in Oncology: The Need for a Biomedical Big Data Insight-Providing Federated Network

Real-World Data Quality Framework for Oncology Time to Treatment Discontinuation Use Case: Implementation and Evaluation Study

An overview of Real-World Data infrastructure for cancer research

Ambulatory routine care in oncology in Germany: real-world survival data

External Control Arm with Synthetic Real-world Data for Comparative Oncology using Single Trial Arm Evidence (ECLIPSE): A Case Study using Lung-MAP S1400I