Abstract:Aim: Regulatory and health technology assessment (HTA) agencies have increasingly published frameworks, guidelines, and recommendations for the use of real-world evidence (RWE) in healthcare decision-making. Variations in the scope and content of these documents, with updates running in parallel, may create challenges for their implementation especially during the market authorization and reimbursement phases of a medicine's life cycle. This environmental scan aimed to comprehensively identify and summarize the guidance documents for RWE developed by most well-established regulatory and reimbursement agencies, as well as other organizations focused on healthcare decision-making, and present their similarities and differences. Methods: RWE guidance documents, including white papers from regulatory and HTA agencies, were reviewed in March 2024. Data on scope and recommendations from each body were extracted by two reviewers and similarities and differences were summarized across four topics: study planning, choosing fit-for-purpose data, study conduct, and reporting. Post-authorization or non-pharmacological guidance was excluded. Results: Forty-six documents were identified across multiple agencies; US FDA produced the most RWE-related guidance. All agencies addressed specific and often similar methodological issues related to study design, data fitness-for-purpose, reliability, and reproducibility, although inconsistency in terminologies on these topics was noted. Two HTA bodies (National Institute for Health and Care Excellence [NICE] and Canada's Drug Agency) each centralized all related RWE guidance under a unified framework. RWE quality tools and checklists were not consistently named and some differences in preferences were noted. European Medicines Agency, NICE, Haute Autorité de Santé, and the Institute for Quality and Efficiency in Health Care included specific recommendations on the use of analytical approaches to address RWE complexities and increase trust in its findings. Conclusion: Similarities in agencies' expectations on RWE studies design, quality elements, and reporting will facilitate evidence generation strategy and activities for manufacturers facing multiple, including global, regulatory and reimbursement submissions and re-submissions. A strong preference by decision-making bodies for local real-world data generation may hinder opportunities for data sharing and outputs from international federated data networks. Closer collaboration between decision-making agencies towards a harmonized RWE roadmap, which can be centrally preserved in a living mode, will provide manufacturers and researchers clarity on minimum acceptance requirements and expectations, especially as novel methodologies for RWE generation are rapidly emerging.

Quantifying Fit-for-Purpose in Real World Data: Data Grading and FitQ Scores

Real-World Data and Real-World Evidence in Healthcare in the United States and Europe Union

Assessing The Practice Of Data Quality Evaluation In A National Clinical Data Research Network Through A Systematic Scoping Review In The Era Of Real-World Data

The Use of Real-World Data/evidence in Regulatory Submissions.

Real-World Evidence: A Primer

Real-World Data Quality Framework for Oncology Time to Treatment Discontinuation Use Case: Implementation and Evaluation Study

Contemporary Practice and Considerations for Real-World Data Source Identification and Feasibility Assessment

Generating Real-World Evidence from Unstructured Clinical Notes to Examine Clinical Utility of Genetic Tests: Use Case in BRCAness

On the use of RWD in support of regulatory submission in drug development

Use of Real‐World Evidence to Drive Drug Development Strategy and Inform Clinical Trial Design

Lessons on the use of real-world data in medical device research: findings from the National Evaluation System for Health Technology Test-Cases

Clinical Pharmacology Applications of Real‐World Data and Real‐World Evidence in Drug Development and Approval–An Industry Perspective

The maze of real-world evidence frameworks: from a desert to a jungle! An environmental scan and comparison across regulatory and health technology assessment agencies

A Web-Based Tool to Evaluate Data Quality of Reused Health Data Assets

[Methodology progress and challenges on assessing the appropriateness of real-world data]

Use of Real-World Data and Real-World Evidence in Rare Disease Drug Development: A Statistical Perspective

RWE Framework: An Interactive Visual Tool to Support a Real-World Evidence Study Design

Seeing the whole elephant: integrated advanced data analytics in support of RWE for the development and use of innovative pharmaceuticals

Unlocking the Power of Real-World Data: A Framework for Sustainable Healthcare

Current Status, Challenges, and Future Perspectives of Real-World Data and Real-World Evidence in Japan

Real-world evidence to support regulatory submissions: A landscape review and assessment of use cases