Abstract:Intersection is one of the most accident-prone urban scenarios for autonomous driving wherein making safe and computationally efficient decisions is non-trivial. Current research mainly focuses on the simplified traffic conditions while ignoring the existence of mixed traffic flows, i.e., vehicles, cyclists and pedestrians. For urban roads, different participants lead to a quite dynamic and complex interaction, posing great difficulty to learn an intelligent policy. This paper develops the dynamic permutation state representation in the framework of integrated decision and control (IDC) to handle signalized intersections with mixed traffic flows. Specially, this representation introduces an encoding function and summation operator to construct driving states from environmental observation, capable of dealing with different types and variant number of traffic participants. A constrained optimal control problem is built wherein the objective involves tracking performance and the constraints for different participants, roads and signal lights are designed respectively to assure safety. We solve this problem by gradient-based optimization, wherein the reasonable state will be given by the encoding function and then served as the input of policy and value function. An off-policy training is designed to reuse observations from driving environment and backpropagation through time is utilized to update the policy function and encoding function jointly. Verification result shows that the dynamic permutation state representation can enhance the driving performance of IDC, including comfort, decision compliance and safety with a large margin. The trained driving policy can realize efficient and smooth passing in the complex intersection, guaranteeing driving intelligence and safety simultaneously.

Safe and Adaptive Decision Algorithm of Automated Vehicle for Unsignalized Intersection Driving

Safe, Efficient and Socially-Compatible Decision of Automated Vehicles: a Case Study of Unsignalized Intersection Driving

Game-based Decision Algorithm for Socially Compatible Automated Driving: a Case Study of Unsignalized Intersection Driving

Human-like driving decision at unsignalized intersections based on game theory

Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections

Driving Conflict Resolution of Autonomous Vehicles at Unsignalized Intersections: A Differential Game Approach

Intelligent Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Scenarios

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments

Brain-Inspired Modeling and Decision-Making for Human-Like Autonomous Driving in Mixed Traffic Environment

Interactive Decision-Making With Switchable Game Modes for Automated Vehicles at Intersections

Interaction-Aware Decision Making for Autonomous Vehicles

Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification

A Game-Theoretic Approach on Conflict Resolution of Autonomous Vehicles at Unsignalized Intersections

Brain-Inspired Modelling and Decision-making for Human-Like Autonomous Driving in Mixed Traffic Environment

Dynamic Game-Theoretical Decision-Making Framework for Vehicle-Pedestrian Interaction with Human Bounded Rationality

AF-DQN: A Large-Scale Decision-Making Method at Unsignalized Intersections with Safe Action Filter and Efficient Exploratory Training Strategy

Safe Intersection Management for Mixed Transportation Systems with Human-Driven and Autonomous Vehicles

Intention-Aware Autonomous Driving Decision-Making in an Uncontrolled Intersection

Cooperative Decision Making of Lane-change for Automated Vehicles Considering Human-like Driving Characteristics

Self-Learned Intelligence for Integrated Decision and Control of Automated Vehicles at Signalized Intersections

Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach