Abstract:Decision-making for autonomous driving is challenging, considering the complex interactions among multiple traffic agents (e.g., autonomous vehicles (AVs), human drivers, and pedestrians) and the computational load needed to evaluate these interactions. This paper develops two general potential game based frameworks, namely, finite and continuous potential games, for decision-making in autonomous driving. The two frameworks account for the AVs' two types of action spaces, i.e., finite and continuous action spaces, respectively. We show that the developed frameworks provide theoretical guarantees, including 1) existence of pure-strategy Nash equilibria, 2) convergence of the Nash equilibrium (NE) seeking algorithms, and 3) global optimality of the derived NE (in the sense that both self- and team- interests are optimized). In addition, we provide cost function shaping approaches to constructing multi-agent potential games in autonomous driving. Moreover, two solution algorithms, including self-play dynamics (e.g., best response dynamics) and potential function optimization, are developed for each game. The developed frameworks are then applied to two different traffic scenarios, including intersection-crossing and lane-changing in highways. Statistical comparative studies, including 1) finite potential game vs. continuous potential game, and 2) best response dynamics vs. potential function optimization, are conducted to compare the performances of different solution algorithms. It is shown that both developed frameworks are practical (i.e., computationally efficient), reliable (i.e., resulting in satisfying driving performances in diverse scenarios and situations), and robust (i.e., resulting in satisfying driving performances against uncertain behaviors of the surrounding vehicles) for real-time decision-making in autonomous driving.

A Game-Theoretical Approach to Driving Decision Making in Highway Scenarios.

Describing Driving Behaviors Based on Decision Optimization Model

Game-Theoretic Lane Change Decision-Making Method Considering Traffic Trend

Intelligent Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Scenarios

Game Theoretic Decision Making by Actively Learning Human Intentions Applied on Autonomous Driving

Potential Game-Based Decision-Making for Autonomous Driving

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments

Game-based Decision Algorithm for Socially Compatible Automated Driving: a Case Study of Unsignalized Intersection Driving

Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach

Integrated Decision Making and Trajectory Planning for Autonomous Driving Under Multimodal Uncertainties: A Bayesian Game Approach

Human-like driving decision at unsignalized intersections based on game theory

A Game Theory-Based Approach for Modeling Autonomous Vehicle Behavior in Congested, Urban Lane-Changing Scenarios

Interactive Decision-Making With Switchable Game Modes for Automated Vehicles at Intersections

Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identification

Towards a systematic computational framework for modeling multi-agent decision-making at micro level for smart vehicles in a smart world

Markov Probabilistic Decision Making of Self-Driving Cars in Highway with Random Traffic Flow: a Simulation Study

Game-theory Based Driving Decision Algorithm for Intersection Scenarios Considering Driver Irrationality

Brain-Inspired Modeling and Decision-Making for Human-Like Autonomous Driving in Mixed Traffic Environment

Dynamic Game-Theoretical Decision-Making Framework for Vehicle-Pedestrian Interaction with Human Bounded Rationality

A Game-Theoretic Model of Human Driving and Application to Discretionary Lane-Changes