Abstract:Computational models of patients and medical devices can be combined to perform an in silico clinical trial (ISCT) to investigate questions related to device safety and/or effectiveness across the total product life cycle. ISCTs can potentially accelerate product development by more quickly informing device design and testing or they could be used to refine, reduce, or in some cases to completely replace human subjects in a clinical trial. There are numerous potential benefits of ISCTs. An important caveat, however, is that an ISCT is a virtual representation of the real world that has to be shown to be credible before being relied upon to make decisions that have the potential to cause patient harm. There are many challenges to establishing ISCT credibility. ISCTs can integrate many different submodels that potentially use different modeling types (e.g., physics-based, data-driven, rule-based) that necessitate different strategies and approaches for generating credibility evidence. ISCT submodels can include those for the medical device, the patient, the interaction of the device and patient, generating virtual patients, clinical decision making and simulating an intervention (e.g., device implantation), and translating acute physics-based simulation outputs to health-related clinical outcomes (e.g., device safety and/or effectiveness endpoints). Establishing the credibility of each ISCT submodel is challenging, but is nonetheless important because inaccurate output from a single submodel could potentially compromise the credibility of the entire ISCT. The objective of this study is to begin addressing some of these challenges and to identify general strategies for establishing ISCT credibility. Most notably, we propose a hierarchical approach for assessing the credibility of an ISCT that involves systematically gathering credibility evidence for each ISCT submodel in isolation before demonstrating credibility of the full ISCT. Also, following FDA Guidance for assessing computational model credibility, we provide suggestions for ways to clearly describe each of the ISCT submodels and the full ISCT, discuss considerations for performing an ISCT model risk assessment, identify common challenges to demonstrating ISCT credibility, and present strategies for addressing these challenges using our proposed hierarchical approach. Finally, in the Appendix we illustrate the many concepts described here using a hypothetical ISCT example.

Consideration of a Credibility Assessment Framework in Model‐Informed Drug Development: Potential Application to Physiologically‐Based Pharmacokinetic Modeling and Simulation

Application of Ivive and Pbpk Modeling in Prospective Prediction of Clinical Pharmacokinetics: Strategy and Approach During the Drug Discovery Phase with Four Case Studies

Scientific and regulatory evaluation of mechanistic in silico drug and disease models in drug development: Building model credibility

Model‐Informed Drug Development: Current US Regulatory Practice and Future Considerations

Review: Role of Model-Informed Drug Development Approaches in the Lifecycle of Drug Development and Regulatory Decision-Making

Model-informed drug development in pediatric, pregnancy and geriatric drug development: States of the art and future

Incorporating Historical Information to Improve Phase I Clinical Trials

Towards More Robust Evaluation of the Predictive Performance of Physiologically Based Pharmacokinetic Models: Using Confidence Intervals to Support Use of Model-Informed Dosing in Clinical Care

Toward trustworthy medical device in silico clinical trials: a hierarchical framework for establishing credibility and strategies for overcoming key challenges

Adapting modeling and simulation credibility standards to computational systems biology

Best Practice in the Use of Physiologically Based Pharmacokinetic Modeling and Simulation to Address Clinical Pharmacology Regulatory Questions

Physiologically based pharmacokinetic modeling in drug discovery and development: A pharmaceutical industry perspective

Generating Model Integrated Evidence for Generic Drug Development and Assessment

PBPK modeling and simulation in drug research and development

The Use of Physiologically Based Pharmacokinetic Analyses-in Biopharmaceutics Applications -Regulatory and Industry Perspectives

Dose Optimization Informed by PBPK Modeling: State‐of‐the Art and Future

Credibility assessment of in silico clinical trials for medical devices

Model-Informed Drug Development: In Silico Assessment of Drug Bioperformance following Oral and Percutaneous Administration

PBBM Considerations for Base Models, Model Validation, and Application Steps: Workshop Summary Report

Stability Modeling Methodologies to Enable Earlier Patient Access

Application of Physiologically Based Pharmacokinetic Modeling in Preclinical Studies: A Feasible Strategy to Practice the Principles of 3Rs