Abstract:Aim: Regulatory and health technology assessment (HTA) agencies have increasingly published frameworks, guidelines, and recommendations for the use of real-world evidence (RWE) in healthcare decision-making. Variations in the scope and content of these documents, with updates running in parallel, may create challenges for their implementation especially during the market authorization and reimbursement phases of a medicine's life cycle. This environmental scan aimed to comprehensively identify and summarize the guidance documents for RWE developed by most well-established regulatory and reimbursement agencies, as well as other organizations focused on healthcare decision-making, and present their similarities and differences. Methods: RWE guidance documents, including white papers from regulatory and HTA agencies, were reviewed in March 2024. Data on scope and recommendations from each body were extracted by two reviewers and similarities and differences were summarized across four topics: study planning, choosing fit-for-purpose data, study conduct, and reporting. Post-authorization or non-pharmacological guidance was excluded. Results: Forty-six documents were identified across multiple agencies; US FDA produced the most RWE-related guidance. All agencies addressed specific and often similar methodological issues related to study design, data fitness-for-purpose, reliability, and reproducibility, although inconsistency in terminologies on these topics was noted. Two HTA bodies (National Institute for Health and Care Excellence [NICE] and Canada's Drug Agency) each centralized all related RWE guidance under a unified framework. RWE quality tools and checklists were not consistently named and some differences in preferences were noted. European Medicines Agency, NICE, Haute Autorité de Santé, and the Institute for Quality and Efficiency in Health Care included specific recommendations on the use of analytical approaches to address RWE complexities and increase trust in its findings. Conclusion: Similarities in agencies' expectations on RWE studies design, quality elements, and reporting will facilitate evidence generation strategy and activities for manufacturers facing multiple, including global, regulatory and reimbursement submissions and re-submissions. A strong preference by decision-making bodies for local real-world data generation may hinder opportunities for data sharing and outputs from international federated data networks. Closer collaboration between decision-making agencies towards a harmonized RWE roadmap, which can be centrally preserved in a living mode, will provide manufacturers and researchers clarity on minimum acceptance requirements and expectations, especially as novel methodologies for RWE generation are rapidly emerging.

Development of a Canadian Guidance for reporting real-world evidence for regulatory and health-technology assessment (HTA) decision-making

The maze of real-world evidence frameworks: from a desert to a jungle! An environmental scan and comparison across regulatory and health technology assessment agencies

A Review and Comparative Case Study Analysis of Real-World Evidence in European Regulatory and Health Technology Assessment Decision Making for Oncology Medicines

Advancing the use of real world evidence in health technology assessment: insights from a multi-stakeholder workshop

Real-world data: a comprehensive literature review on the barriers, challenges, and opportunities associated with their inclusion in the health technology assessment process

Real-world evidence for coverage determination of treatments for rare diseases

RWE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment: part 16

Acceptability of using Real-World Data to Estimate Relative Treatment Effects in Health Technology Assessments: Barriers and Future Steps

Contribution of Real‐World Evidence in European Medicines Agency's Regulatory Decision Making

Application of Multi-Criteria Decision Analysis (MCDA) to Prioritize Real-World Evidence Studies for Health Technology Management: Outcomes and Lessons Learned by the Canadian Real-World Evidence for Value of Cancer Drugs (CanREValue) Collaboration

Use of real-world evidence in meta-analyses and cost-effectiveness models

Real‐World Evidence to Inform Regulatory Decision Making: A Scoping Review

Real-world evidence to support regulatory submissions: A landscape review and assessment of use cases

Use of Real-World Evidence for Regulatory Approval and Coverage of Medical Devices: A Landscape Assessment

HARmonized Protocol Template to Enhance Reproducibility of hypothesis evaluating real-world evidence studies on treatment effects: A good practices report of a joint ISPE/ISPOR task force

Building a National Reassessment Process for Oncology Drugs: Lessons Learned by the Canadian Real-World Evidence for Value of Cancer Drugs (CanREValue) Collaboration through a Simulated Reassessment Exercise

Real-World Data and Real-World Evidence in Healthcare in the United States and Europe Union

Contemporary Practice and Considerations for Real-World Data Source Identification and Feasibility Assessment

R WE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment: part 14

Use of Real‐World Evidence to Drive Drug Development Strategy and Inform Clinical Trial Design

Use of real‐world evidence in regulatory decisions for rare diseases in the United States—Current status and future directions