Abstract:Intersection is one of the most accident-prone urban scenarios for autonomous driving wherein making safe and computationally efficient decisions is non-trivial. Current research mainly focuses on the simplified traffic conditions while ignoring the existence of mixed traffic flows, i.e., vehicles, cyclists and pedestrians. For urban roads, different participants lead to a quite dynamic and complex interaction, posing great difficulty to learn an intelligent policy. This paper develops the dynamic permutation state representation in the framework of integrated decision and control (IDC) to handle signalized intersections with mixed traffic flows. Specially, this representation introduces an encoding function and summation operator to construct driving states from environmental observation, capable of dealing with different types and variant number of traffic participants. A constrained optimal control problem is built wherein the objective involves tracking performance and the constraints for different participants, roads and signal lights are designed respectively to assure safety. We solve this problem by gradient-based optimization, wherein the reasonable state will be given by the encoding function and then served as the input of policy and value function. An off-policy training is designed to reuse observations from driving environment and backpropagation through time is utilized to update the policy function and encoding function jointly. Verification result shows that the dynamic permutation state representation can enhance the driving performance of IDC, including comfort, decision compliance and safety with a large margin. The trained driving policy can realize efficient and smooth passing in the complex intersection, guaranteeing driving intelligence and safety simultaneously.

Joint Imitation Learning of Behavior Decision and Control for Autonomous Intersection Navigation

Learning Autonomous Control Policy for Intersection Navigation with Pedestrian Interaction

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

Multi-Task Conditional Imitation Learning for Autonomous Navigation at Crowded Intersections

Learning a Decision Module by Imitating Driver's Control Behaviors

Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safety

Intention-Aware Autonomous Driving Decision-Making in an Uncontrolled Intersection

SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environments

Human-Like Decision Making for Autonomous Vehicles at the Intersection Using Inverse Reinforcement Learning

Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections

Human-Like Decision Making and Planning for Autonomous Driving with Reinforcement Learning

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery

Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning.

A Hierarchical Imitation Learning-based Decision Framework for Autonomous Driving

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments

Deep Reinforcement Learning Based Game-Theoretic Decision-Making for Autonomous Vehicles

Self-Learned Intelligence for Integrated Decision and Control of Automated Vehicles at Signalized Intersections

Autonomous Vehicle Decision-Making at Unsignalized Intersection via Deep Reinforcement Learning

Driver Behavior Decision Making Based on Multi-Action Deep Q Network in Dynamic Traffic Scenes.

A Multi-Task Reinforcement Learning Approach for Navigating Unsignalized Intersections