Abstract:Automated driving is essential for developing and deploying intelligent transportation systems. However, unavoidable sensor noises or perception errors may cause an automated vehicle to adopt suboptimal driving policies or even lead to catastrophic failures. Additionally, the automated driving longitudinal and lateral decision-making behaviors (e.g., driving speed and lane changing decisions) are coupled, that is, when one of them is perturbed by unknown external disturbances, it causes changes or even performance degradation in the other. The presence of both challenges significantly curtails the potential of automated driving. Here, to coordinate the longitudinal and lateral driving decisions of an automated vehicle while ensuring policy robustness against observational uncertainties, we propose a novel robust coordinated decision-making technique via robust multiagent reinforcement learning. Specifically, the automated driving longitudinal and lateral decisions under observational perturbations are modeled as a constrained robust multiagent Markov decision process. Meanwhile, a nonlinear constraint setting with Kullback–Leibler divergence is developed to keep the variation of the driving policy perturbed by stochastic perturbations within bounds. Additionally, a robust multiagent policy optimization approach is proposed to approximate the optimal robust coordinated driving policy. Finally, we evaluate the proposed robust coordinated decision-making method in three highway scenarios with different traffic densities. Quantitatively, in the absence of noises, the proposed method achieves an approximate average enhancement of 25.58% in traffic efficiency and 91.31% in safety compared to all baselines across the three scenarios. In the presence of noises, our technique improves traffic efficiency and safety by an approximate average of 30.81% and 81.02% compared to all baselines in the three scenarios, respectively. The results demonstrate that the proposed approach is capable of improving automated driving performance and ensuring policy robustness against observational uncertainties.

Meta Soft Actor-Critic Based Robust Sequential Power Control in Vehicular Networks

Hybrid Multi-Agent Reinforcement Learning for Electric Vehicle Resilience Control Towards a Low-Carbon Transition

Distributed Robust Power Control in Two-Tier Vehicle Networks under Uncertain Channel Environments

Energy Efficient Transmission in Underlay CR-NOMA Networks Enabled by Reinforcement Learning

Joint Spectrum Allocation and Power Control in Vehicular Networks Based on Reinforcement Learning.

Reinforcement Learning Based Power Control for VANET Broadcast Against Jamming

Deep Actor-Critic Learning for Distributed Power Control in Wireless Mobile Networks

Power Control of 5G-Connected Vehicular Network Using PPO-Based Deep Reinforcement Learning Algorithm

Decentralized Deep Reinforcement Learning for Delay-Power Tradeoff in Vehicular Communications

Non-orthogonal Age-Optimal Information Dissemination in Vehicular Networks: A Meta Multi-Objective Reinforcement Learning Approach

Multi-Agent Reinforcement Learning Based Adaptive Parameter Optimization for Semi-Persistent Scheduling in C- V2X Mode 4

Reinforcement Learning Based Power Control for Reliable Mission-Critical Wireless Transmission

Intelligent Resource Management Based on Reinforcement Learning for Ultra-Reliable and Low-Latency IoV Communication Networks

Active power correction strategies based on deep reinforcement learning-part I: A simulation-driven solution for robustness

Adaptive Sidelink Open Loop Power Control Optimization Strategies for Vehicle-to- Vehicle Communications in 5G-NR-V2X

Robust Power Control for Clustering-Based Vehicle-to-Vehicle Communication

Robust Multiagent Reinforcement Learning Toward Coordinated Decision-Making of Automated Vehicles

Energy-Efficient Resource Allocation for V2X Communications

Online Prediction-Assisted Safe Reinforcement Learning for Electric Vehicle Charging Station Recommendation in Dynamically Coupled Transportation-Power Systems

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Communication Scheduling by Deep Reinforcement Learning for Remote Traffic State Estimation with Bayesian Inference