Abstract:Decision-making for autonomous driving is challenging, considering the complex interactions among multiple traffic agents (e.g., autonomous vehicles (AVs), human drivers, and pedestrians) and the computational load needed to evaluate these interactions. This paper develops two general potential game based frameworks, namely, finite and continuous potential games, for decision-making in autonomous driving. The two frameworks account for the AVs' two types of action spaces, i.e., finite and continuous action spaces, respectively. We show that the developed frameworks provide theoretical guarantees, including 1) existence of pure-strategy Nash equilibria, 2) convergence of the Nash equilibrium (NE) seeking algorithms, and 3) global optimality of the derived NE (in the sense that both self- and team- interests are optimized). In addition, we provide cost function shaping approaches to constructing multi-agent potential games in autonomous driving. Moreover, two solution algorithms, including self-play dynamics (e.g., best response dynamics) and potential function optimization, are developed for each game. The developed frameworks are then applied to two different traffic scenarios, including intersection-crossing and lane-changing in highways. Statistical comparative studies, including 1) finite potential game vs. continuous potential game, and 2) best response dynamics vs. potential function optimization, are conducted to compare the performances of different solution algorithms. It is shown that both developed frameworks are practical (i.e., computationally efficient), reliable (i.e., resulting in satisfying driving performances in diverse scenarios and situations), and robust (i.e., resulting in satisfying driving performances against uncertain behaviors of the surrounding vehicles) for real-time decision-making in autonomous driving.

Game Projection and Robustness for Game-Theoretic Autonomous Driving

Potential Game-Based Decision-Making for Autonomous Driving

Safe and Human-Like Autonomous Driving: A Predictor-Corrector Potential Game Approach

Potential Game Based Decision-Making Frameworks for Autonomous Driving

Adaptive Robust Game-Theoretic Decision Making for Autonomous Vehicles

Integrated Decision Making and Trajectory Planning for Autonomous Driving Under Multimodal Uncertainties: A Bayesian Game Approach

Game-Theoretic Modeling of Multi-Vehicle Interactions at Uncontrolled Intersections

Cooperative Path Following Control in Autonomous Vehicles Graphical Games: A Data-Based Off-Policy Learning Approach

Solution Concepts in Hierarchical Games under Bounded Rationality with Applications to Autonomous Driving

Driving Conflict Resolution of Autonomous Vehicles at Unsignalized Intersections: A Differential Game Approach

A Game-Theoretical Approach to Driving Decision Making in Highway Scenarios.

Autonomous Driving Decision Algorithm for Complex Multi-Vehicle Interactions: An Efficient Approach Based on Global Sorting and Local Gaming

Manoeuvre Prediction and Planning for Automated and Connected Vehicles Based on Interaction and Gaming Awareness under Uncertainty

Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification

Intelligent Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Scenarios

Game Theoretic Modeling of Driver and Vehicle Interactions for Verification and Validation of Autonomous Vehicle Control Systems

Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments

Generalized dynamic cognitive hierarchy models for strategic driving behavior

Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach