Art Sedrakyan,Danica Marinac-Dabic,Bruce Campbell,Suvekshya Aryal,Courtney E Baird,Philip Goodney,Jack L Cronenwett,Adam W Beck,Elizabeth W Paxton,Jim Hu,Ralph Brindis,Kevin Baskin,Terrie Cowley,Jeffery Levy,David S Liebeskind,Benjamin K Poulose,Charles R Rardin,Frederic S Resnic,James Tcheng,Benjamin Fisher,Charles Viviano,Vincent Devlin,Murray Sheldon,Jens Eldrup-Jorgensen,Jesse A Berlin,Joseph Drozda,Michael E Matheny,Sanket S Dhruva,Timothy Feeney,Kristi Mitchell,Gregory Pappas

Abstract:Objectives: Generating and using real-world evidence (RWE) is a pragmatic solution for evaluating health technologies. RWE is recognized by regulators, health technology assessors, clinicians, and manufacturers as a valid source of information to support their decision-making. Well-designed registries can provide RWE and become more powerful when linked with electronic health records and administrative databases in coordinated registry networks (CRNs). Our objective was to create a framework of maturity of CRNs and registries, so guiding their development and the prioritization of funding. Design setting and participants: We invited 52 stakeholders from diverse backgrounds including patient advocacy groups, academic, clinical, industry and regulatory experts to participate on a Delphi survey. Of those invited, 42 participated in the survey to provide feedback on the maturity framework for CRNs and registries. An expert panel reviewed the responses to refine the framework until the target consensus of 80% was reached. Two rounds of the Delphi were distributed via Qualtrics online platform from July to August 2020 and from October to November 2020. Main outcome measures: Consensus on the maturity framework for CRNs and registries consisted of seven domains (unique device identification, efficient data collection, data quality, product life cycle approach, governance and sustainability, quality improvement, and patient-reported outcomes), each presented with five levels of maturity. Results: Of 52 invited experts, 41 (79.9%) responded to round 1; all 41 responded to round 2; and consensus was reached for most domains. The expert panel resolved the disagreements and final consensus estimates ranged from 80.5% to 92.7% for seven domains. Conclusions: We have developed a robust framework to assess the maturity of any CRN (or registry) to provide reliable RWE. This framework will promote harmonization of approaches to RWE generation across different disciplines and health systems. The domains and their levels may evolve over time as new solutions become available.

Post-approval evidence generation: a shared responsibility for healthcare

Overcoming the barriers to better evidence generation from clinical trials

Lifecycle evidence requirements for high-risk implantable medical devices: a European perspective

Regulatory perspectives on post-market evidence generation schemes for high-risk medical devices: a systematic review

Generating Evidence from Expanded Access Use of Rare Disease Medicines: Challenges and Recommendations

The need for transparency of clinical evidence for medical devices in Europe

Evidence-based clinical practice, [corrected] evidence-based medicine and the Cochrane collaboration

Evidence-Based Risk Management: How Can We Succeed?: Deliberations from a Risk Management Advisory Council

Using Certification to Promote Uptake of Real-World Evidence by Payers

Generating Appropriate and Reliable Evidence for Value Assessment of Medical Devices: An ISPOR Medical Devices and Diagnostics Special Interest Group Report

Transforming health care from the inside out: advancing evidence-based practice in the 21st century

Advancing the Real-World Evidence for Medical Devices through Coordinated Registry Networks

Generating and translating evidence for safe and effective medication management in aged care homes

The use of mechanistic evidence in drug approval

Real-world evidence and regulatory drug approval

Insights into post-marketing clinical validation of companion diagnostics with reference to the FDA, EMA, PMDA, and MFDS

Need for evidence synthesis for quality control of healthcare decision-making

Generating real‐world evidence in Alzheimer's disease: Considerations for establishing a core dataset

Challenges for the evaluation of digital health solutions—A call for innovative evidence generation approaches

A new platform for post-marketing surveillance and real-world evidence data collection for substance-based medical devices

CME CLINICAL COMMENTARY REVIEW: Patient Centered Practice Guidelines: GRADEing Evidence to Incorporate Certainty, Balance Between Benefits and Harms, Equity, Feasibility, and Cost-Effectiveness