Abstract:Automated driving is essential for developing and deploying intelligent transportation systems. However, unavoidable sensor noises or perception errors may cause an automated vehicle to adopt suboptimal driving policies or even lead to catastrophic failures. Additionally, the automated driving longitudinal and lateral decision-making behaviors (e.g., driving speed and lane changing decisions) are coupled, that is, when one of them is perturbed by unknown external disturbances, it causes changes or even performance degradation in the other. The presence of both challenges significantly curtails the potential of automated driving. Here, to coordinate the longitudinal and lateral driving decisions of an automated vehicle while ensuring policy robustness against observational uncertainties, we propose a novel robust coordinated decision-making technique via robust multiagent reinforcement learning. Specifically, the automated driving longitudinal and lateral decisions under observational perturbations are modeled as a constrained robust multiagent Markov decision process. Meanwhile, a nonlinear constraint setting with Kullback–Leibler divergence is developed to keep the variation of the driving policy perturbed by stochastic perturbations within bounds. Additionally, a robust multiagent policy optimization approach is proposed to approximate the optimal robust coordinated driving policy. Finally, we evaluate the proposed robust coordinated decision-making method in three highway scenarios with different traffic densities. Quantitatively, in the absence of noises, the proposed method achieves an approximate average enhancement of 25.58% in traffic efficiency and 91.31% in safety compared to all baselines across the three scenarios. In the presence of noises, our technique improves traffic efficiency and safety by an approximate average of 30.81% and 81.02% compared to all baselines in the three scenarios, respectively. The results demonstrate that the proposed approach is capable of improving automated driving performance and ensuring policy robustness against observational uncertainties.

Improving Agent Behaviors with RL Fine-tuning for Autonomous Driving

Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey

SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Driving

Optimizing Autonomous Driving for Safety: A Human-Centric Approach with LLM-Enhanced RLHF

Federated Transfer Reinforcement Learning for Autonomous Driving

CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learning

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning

Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Driving

Stabilization Approaches for Reinforcement Learning-Based End-to-End Autonomous Driving

Enhancing State Representation in Multi-Agent Reinforcement Learning for Platoon-Following Models

Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarios

Learning Realistic Traffic Agents in Closed-loop

Trustworthy safety improvement for autonomous driving using reinforcement learning

Reinforcement Learning Based Oscillation Dampening: Scaling up Single-Agent RL algorithms to a 100 AV highway field operational test

Risk-Aware Reward Shaping of Reinforcement Learning Agents for Autonomous Driving

Robust Multiagent Reinforcement Learning Toward Coordinated Decision-Making of Automated Vehicles

Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors

Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network

Building Safer Autonomous Agents by Leveraging Risky Driving Behavior Knowledge

Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2)

Think2Drive: Efficient Reinforcement Learning by Thinking with Latent World Model for Autonomous Driving (in CARLA-v2)