Abstract:Context: Demonstrating high reliability and safety for safety-critical systems (SCSs) remains a hard problem. Diverse evidence needs to be combined in a rigorous way: in particular, results of operational testing with other evidence from design and verification. Growing use of machine learning in SCSs, by precluding most established methods for gaining assurance, makes evidence from operational testing even more important for supporting safety and reliability claims.Objective: We revisit the problem of using operational testing to demonstrate high reliability. We use Autonomous Vehicles (AVs) as a current example. AVs are making their debut on public roads: methods for assessing whether an AV is safe enough are urgently needed. We demonstrate how to answer 5 questions that would arise in assessing an AV type, starting with those proposed by a highly-cited study.Method: We apply new theorems extending our Conservative Bayesian Inference (CBI) approach, which exploit the rigour of Bayesian methods while reducing the risk of involuntary misuse associated (we argue) with now-common applications of Bayesian inference; we define additional conditions needed for applying these methods to AVs.Results: Prior knowledge can bring substantial advantages if the AV design allows strong expectations of safety before road testing. We also show how naive attempts at conservative assessment may lead to over-optimism instead; why extrapolating the trend of disengagements (take-overs by human drivers) is not suitable for safety claims; use of knowledge that an AV has moved to a "less stressful" environment.Conclusion: While some reliability targets will remain too high to be practically verifiable, our CBI approach removes a major source of doubt: it allows use of prior knowledge without inducing dangerously optimistic biases. For certain ranges of required reliability and prior beliefs, CBI thus supports feasible, sound arguments. Useful conservative claims can be derived from limited prior knowledge.

Towards Identifying and closing Gaps in Assurance of autonomous Road vehicleS -- a collection of Technical Notes Part 1

A taxonomy of validation strategies to ensure the safe operation of highly automated vehicles

Assessing the Safety and Reliability of Autonomous Vehicles from Road Testing

Behaviour Description Database for AVs in Singapore

Simulation Assessment Guidelines towards Independent Safety Assurance of Autonomous Vehicles

Performance Evaluation of an Autonomous Vehicle Using Resilience Engineering

Closing the gap towards end-to-end autonomous vehicle system

Paving the Roadway for Safety of Automated Vehicles: An Empirical Study on Testing Challenges

Exploring the Boundaries: Thorough Software Testing for Safety-Critical Driving Scenarios Based on Kinematics in the Context of Autonomous Driving

Uncertainties in Onboard Algorithms for Autonomous Vehicles: Challenges, Mitigation, and Perspectives.

Longitudinal Functional Safety Analysis and Algorithm Design of Traffic Jam Pilot

Coverage based testing for V&V and Safety Assurance of Self-driving Autonomous Vehicles: A Systematic Literature Review

Exploring the Assessment List for Trustworthy AI in the Context of Advanced Driver-Assistance Systems

Rigorous Simulation-based Testing for Autonomous Driving Systems -- Targeting the Achilles' Heel of Four Open Autopilots

Characterization and Mitigation of Insufficiencies in Automated Driving Systems

Guidelines for evaluation of complex multi agent test scenarios

Testing autonomous vehicles and AI: perspectives and challenges from cybersecurity, transparency, robustness and fairness

Behavior Trees in Functional Safety Supervisors for Autonomous Vehicles

Assessing safety-critical systems from operational testing: A study on autonomous vehicles

A Comprehensive Evaluation of Vehicle Intelligent Barrier Avoidance Function under Special Roads Based on G1-CRITIC

Autonomous road vehicles: recent issues and expectations