Abstract:Context: Demonstrating high reliability and safety for safety-critical systems (SCSs) remains a hard problem. Diverse evidence needs to be combined in a rigorous way: in particular, results of operational testing with other evidence from design and verification. Growing use of machine learning in SCSs, by precluding most established methods for gaining assurance, makes evidence from operational testing even more important for supporting safety and reliability claims.Objective: We revisit the problem of using operational testing to demonstrate high reliability. We use Autonomous Vehicles (AVs) as a current example. AVs are making their debut on public roads: methods for assessing whether an AV is safe enough are urgently needed. We demonstrate how to answer 5 questions that would arise in assessing an AV type, starting with those proposed by a highly-cited study.Method: We apply new theorems extending our Conservative Bayesian Inference (CBI) approach, which exploit the rigour of Bayesian methods while reducing the risk of involuntary misuse associated (we argue) with now-common applications of Bayesian inference; we define additional conditions needed for applying these methods to AVs.Results: Prior knowledge can bring substantial advantages if the AV design allows strong expectations of safety before road testing. We also show how naive attempts at conservative assessment may lead to over-optimism instead; why extrapolating the trend of disengagements (take-overs by human drivers) is not suitable for safety claims; use of knowledge that an AV has moved to a "less stressful" environment.Conclusion: While some reliability targets will remain too high to be practically verifiable, our CBI approach removes a major source of doubt: it allows use of prior knowledge without inducing dangerously optimistic biases. For certain ranges of required reliability and prior beliefs, CBI thus supports feasible, sound arguments. Useful conservative claims can be derived from limited prior knowledge.

The Unnecessity of Assuming Statistically Independent Tests in Bayesian Software Reliability Assessments

Demonstrating software reliability using possibly correlated tests: Insights from a conservative Bayesian approach

Combining Model Checking and Testing with an Application to Reliability Prediction and Distribution

A Naive Bayesian Belief Network Model for Predicting Effort Deviation Rate in Software Testing

Enhancing Performance of Random Testing Through Markov Chain Monte Carlo Methods

A BAYESIAN HYPOTHESIS TESTING APPROACH FOR FINDING UPPER BOUNDS FOR PROBABILITIES THAT PAIRS OF SOFTWARE COMPONENTS FAIL SIMULTANEOUSLY

Probabilistic confidence for decisions based on uncertain reliability estimates

Bayesian methodology for reliability model acceptance

Assessing safety-critical systems from operational testing: A study on autonomous vehicles

Structural reliability analysis: A Bayesian perspective

Specifying Prior Distributions in Reliability Applications

Advances in Data Combination, Analysis and Collection for System Reliability Assessment

Semantic and Cognitive Tools to Aid Statistical Science: Replace Confidence and Significance by Compatibility and Surprise

Remarks on the statistical aspects of the safety analysis

Efficient Bayesian Inference for a Defect Rate Based on Completely Censored Data

Confidence distributions and hypothesis testing

Software testing and release decision at different statistical confidence levels with consideration of debuggers’ learning and negligent factors

Bayesian Safety Validation for Failure Probability Estimation of Black-Box Systems

Reliability assessment for failure‐dependent and uncertain systems: A Bayesian network based on copula method and probability‐box

On Some Assumptions of the Null Hypothesis Statistical Testing