Abstract:The traditional autonomous driving system (mission layer) is monitored at runtime by the safety layer, which includes verifiable algorithms only. Utilizing the detectability model for such perception algorithms, safety layer provides deterministic fault detection and collision avoidance properties. This framework presents a promising approach towards the end goal of verifiable end‐to‐end safety in autonomous vehicles. Detectability model provides deterministic translation between safety policies, sensors and algorithm parameters and safety guarantees. Such a model can only be devised for fully analysable and verifiable solutions, a requirement not met by deep neural networks. Advances in deep learning have revolutionized cyber‐physical applications, including the development of autonomous vehicles. However, real‐world collisions involving autonomous control of vehicles have raised significant safety concerns regarding the use of deep neural networks (DNNs) in safety‐critical tasks, particularly perception. The inherent unverifiability of DNNs poses a key challenge in ensuring their safe and reliable operation. In this work, we propose perception simplex (PS ), a fault‐tolerant application architecture designed for obstacle detection and collision avoidance. We analyse an existing LiDAR‐based classical obstacle detection algorithm to establish strict bounds on its capabilities and limitations. Such analysis and verification have not been possible for deep learning‐based perception systems yet. By employing verifiable obstacle detection algorithms, PS identifies obstacle existence detection faults in the output of unverifiable DNN‐based object detectors. When faults with potential collision risks are detected, appropriate corrective actions are initiated. Through extensive analysis and software‐in‐the‐loop simulations, we demonstrate that PS provides deterministic fault tolerance against obstacle existence detection faults, establishing a robust safety guarantee.

Perception Simplex: Verifiable Collision Avoidance in Autonomous Vehicles Amidst Obstacle Detection Faults

Perception simplex: Verifiable collision avoidance in autonomous vehicles amidst obstacle detection faults

Verifiable Obstacle Detection

Synergistic Perception and Control Simplex for Verifiable Safe Vertical Landing

Fault-Tolerant Perception for Automated Driving A Lightweight Monitoring Approach

Verifying Controllers with Convolutional Neural Network-based Perception: A Case for Intelligible, Safe, and Precise Abstractions

Deep Learning Safety Concerns in Automated Driving Perception

Towards Safety Verification of Direct Perception Neural Networks

Interaction-Dynamics-Aware Perception Zones for Obstacle Detection Safety Evaluation

Towards Robust LiDAR-based Perception in Autonomous Driving: General Black-box Adversarial Sensor Attack and Countermeasures

REAL-SAP: Real-time Evidence Aware Liable Safety Assessment for Perception in Autonomous Driving

Attacking vision-based perception in end-to-end autonomous driving models

Safety Concerns and Mitigation Approaches Regarding the Use of Deep Learning in Safety-Critical Perception Tasks

A Visual Neural Network for Robust Collision Perception in Vehicle Driving Scenarios

How Does Perception Affect Safety: New Metrics and Strategy

Verification and Design of Robust and Safe Neural Network-enabled Autonomous Systems

Real-time Hazard Detection in Autonomous Vehicles: Deep Learning Approaches for Enhancing Road Safety

Deep Reinforcement Learning-Based Pedestrian and Independent Vehicle Safety Fortification Using Intelligent Perception

SDLV: Verification of Steering Angle Safety for Self-Driving Cars

Runtime Safety Assurance for Learning-enabled Control of Autonomous Driving Vehicles

Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving