Abstract:Automated driving is essential for developing and deploying intelligent transportation systems. However, unavoidable sensor noises or perception errors may cause an automated vehicle to adopt suboptimal driving policies or even lead to catastrophic failures. Additionally, the automated driving longitudinal and lateral decision-making behaviors (e.g., driving speed and lane changing decisions) are coupled, that is, when one of them is perturbed by unknown external disturbances, it causes changes or even performance degradation in the other. The presence of both challenges significantly curtails the potential of automated driving. Here, to coordinate the longitudinal and lateral driving decisions of an automated vehicle while ensuring policy robustness against observational uncertainties, we propose a novel robust coordinated decision-making technique via robust multiagent reinforcement learning. Specifically, the automated driving longitudinal and lateral decisions under observational perturbations are modeled as a constrained robust multiagent Markov decision process. Meanwhile, a nonlinear constraint setting with Kullback–Leibler divergence is developed to keep the variation of the driving policy perturbed by stochastic perturbations within bounds. Additionally, a robust multiagent policy optimization approach is proposed to approximate the optimal robust coordinated driving policy. Finally, we evaluate the proposed robust coordinated decision-making method in three highway scenarios with different traffic densities. Quantitatively, in the absence of noises, the proposed method achieves an approximate average enhancement of 25.58% in traffic efficiency and 91.31% in safety compared to all baselines across the three scenarios. In the presence of noises, our technique improves traffic efficiency and safety by an approximate average of 30.81% and 81.02% compared to all baselines in the three scenarios, respectively. The results demonstrate that the proposed approach is capable of improving automated driving performance and ensuring policy robustness against observational uncertainties.

Multi-adversarial Testing and Retraining for Improving the Robustness of Autonomous Driving Policies

Adversarial Deep Reinforcement Learning for Improving the Robustness of Multi-agent Autonomous Driving Policies

Adversarial Driving Policy Learning by Misunderstanding the Traffic Flow

Improved Robustness and Safety for Autonomous Vehicle Control with Adversarial Reinforcement Learning

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

Adversarial Evaluation of Autonomous Vehicles in Lane-Change Scenarios

Module-wise Adaptive Adversarial Training for End-to-end Autonomous Driving

Robust Deep Reinforcement Learning with Adaptive Adversarial Perturbations in Action Space

Towards Safe Autonomous Driving: Decision Making with Observation-Robust Reinforcement Learning

Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot Learning

Robust Multiagent Reinforcement Learning Toward Coordinated Decision-Making of Automated Vehicles

Less is More: A Stealthy and Efficient Adversarial Attack Method for DRL-based Autonomous Driving Policies

Interpreting Adversarial Examples and Robustness for Deep Learning-Based Auto-Driving Systems

Adversarial Generation of Safety-Critical Lane-Change Scenarios for Autonomous Vehicles

Adversarial Driving Behavior Generation Incorporating Human Risk Cognition for Autonomous Vehicle Evaluation

Toward Evaluating Robustness of Reinforcement Learning with Adversarial Policy

Risk Averse Robust Adversarial Reinforcement Learning

Safe Driving Adversarial Trajectory Can Mislead: Towards More Stealthy Adversarial Attack Against Autonomous Driving Prediction Module

CAT: Closed-loop Adversarial Training for Safe End-to-End Driving

Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles

Adversarial robustness improvement for deep neural networks