Abstract:Self-driving vehicles have their own intelligence to drive on open roads. However, vehicle managers, e.g., government or industrial companies, still need a way to tell these self-driving vehicles what behaviors are encouraged or forbidden. Unlike human drivers, current self-driving vehicles cannot understand the traffic laws, thus rely on the programmers manually writing the corresponding principles into the driving systems. It would be less efficient and hard to adapt some temporary traffic laws, especially when the vehicles use data-driven decision-making algorithms. Besides, current self-driving vehicle systems rarely take traffic law modification into consideration. This work aims to design a road traffic law adaptive decision-making method. The decision-making algorithm is designed based on reinforcement learning, in which the traffic rules are usually implicitly coded in deep neural networks. The main idea is to supply the adaptability to traffic laws of self-driving vehicles by a law-adaptive backup policy. In this work, the natural language-based traffic laws are first translated into a logical expression by the Linear Temporal Logic method. Then, the system will try to monitor in advance whether the self-driving vehicle may break the traffic laws by designing a long-term RL action space. Finally, a sample-based planning method will re-plan the trajectory when the vehicle may break the traffic rules. The method is validated in a Beijing Winter Olympic Lane scenario and an overtaking case, built in CARLA simulator. The results show that by adopting this method, the self-driving vehicles can comply with new issued or updated traffic laws effectively. This method helps self-driving vehicles governed by digital traffic laws, which is necessary for the wide adoption of autonomous driving.

Personalized Decision-making and Control for Automated Vehicles based on Generative Adversarial Imitation Learning

A Shared Control Approach for Autonomous Vehicles via Driver Behaviors Learning

Imitating Driver Behavior with Generative Adversarial Networks

A Method of Personalized Driving Decision for Smart Car Based on Deep Reinforcement Learning

A Study on Learning and Simulating Personalized Car-Following Driving Style

High-Level Decision Making for Automated Highway Driving via Behavior Cloning

SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environments

Learning a Decision Module by Imitating Driver's Control Behaviors

Research on a Personalized Decision Control Algorithm for Autonomous Vehicles Based on the Reinforcement Learning from Human Feedback Strategy

Evolutionary Decision-Making and Planning for Autonomous Driving: A Hybrid Augmented Intelligence Framework

Road Traffic Law Adaptive Decision-making for Self-Driving Vehicles

Decision-making for Connected and Automated Vehicles in Chanllenging Traffic Conditions Using Imitation and Deep Reinforcement Learning

Intelligent Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Scenarios

Parameterized Decision-Making with Multi-Modality Perception for Autonomous Driving

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments

Parameterized Decision-making with Multi-modal Perception for Autonomous Driving

Personalized Lane Change Decision Algorithm Using Deep Reinforcement Learning Approach.

Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles

Integrated Decision and Control for High-Level Automated Vehicles by Mixed Policy Gradient and Its Experiment Verification

Brain-Inspired Modeling and Decision-Making for Human-Like Autonomous Driving in Mixed Traffic Environment

Automated vehicle's behavior decision making using deep reinforcement learning and high-fidelity simulation environment