Abstract:Decision-making for autonomous driving is challenging, considering the complex interactions among multiple traffic agents (e.g., autonomous vehicles (AVs), human drivers, and pedestrians) and the computational load needed to evaluate these interactions. This paper develops two general potential game based frameworks, namely, finite and continuous potential games, for decision-making in autonomous driving. The two frameworks account for the AVs' two types of action spaces, i.e., finite and continuous action spaces, respectively. We show that the developed frameworks provide theoretical guarantees, including 1) existence of pure-strategy Nash equilibria, 2) convergence of the Nash equilibrium (NE) seeking algorithms, and 3) global optimality of the derived NE (in the sense that both self- and team- interests are optimized). In addition, we provide cost function shaping approaches to constructing multi-agent potential games in autonomous driving. Moreover, two solution algorithms, including self-play dynamics (e.g., best response dynamics) and potential function optimization, are developed for each game. The developed frameworks are then applied to two different traffic scenarios, including intersection-crossing and lane-changing in highways. Statistical comparative studies, including 1) finite potential game vs. continuous potential game, and 2) best response dynamics vs. potential function optimization, are conducted to compare the performances of different solution algorithms. It is shown that both developed frameworks are practical (i.e., computationally efficient), reliable (i.e., resulting in satisfying driving performances in diverse scenarios and situations), and robust (i.e., resulting in satisfying driving performances against uncertain behaviors of the surrounding vehicles) for real-time decision-making in autonomous driving.

Solution Concepts in Hierarchical Games under Bounded Rationality with Applications to Autonomous Driving

Generalized dynamic cognitive hierarchy models for strategic driving behavior

Hierarchical Game-Theoretic Planning for Autonomous Vehicles

Integrated Decision Making and Trajectory Planning for Autonomous Driving Under Multimodal Uncertainties: A Bayesian Game Approach

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Potential Game-Based Decision-Making for Autonomous Driving

Dynamic Game-Theoretical Decision-Making Framework for Vehicle-Pedestrian Interaction with Human Bounded Rationality

Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments

Intelligent Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Scenarios

A Game-Theoretical Approach to Driving Decision Making in Highway Scenarios.

Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification

Decentralized Human-Like Control Strategy of Mixed-Flow Multi-Vehicle Interactions at Uncontrolled Intersections: A Game-Theoretic Approach

Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers

Game-Theoretic Modeling of Multi-Vehicle Interactions at Uncontrolled Intersections

Competitive and Cooperative Behaviour Analysis of Connected and Autonomous Vehicles Across Unsignalised Intersections: A Game-Theoretic Approach

A Multi-Vehicle Game-Theoretic Framework for Decision Making and Planning of Autonomous Vehicles in Mixed Traffic

Towards a systematic computational framework for modeling multi-agent decision-making at micro level for smart vehicles in a smart world

Game-Theory in Practice: Application to Motion Planning and Decision Making in an Autonomous Shuttle Bus

Potential Game Based Decision-Making Frameworks for Autonomous Driving