Abstract:This paper proposes a novel decision-making framework for autonomous vehicles (AVs), called predictor-corrector potential game (PCPG), composed of a Predictor and a Corrector. To enable human-like reasoning and characterize agent interactions, a receding-horizon multi-player game is formulated. To address the challenges caused by the complexity in solving a multi-player game and by the requirement of real-time operation, a potential game (PG) based decision-making framework is developed. In the PG Predictor, the agent cost functions are heuristically predefined. We acknowledge that the behaviors of other traffic agents, e.g., human-driven vehicles and pedestrians, may not necessarily be consistent with the predefined cost functions. To address this issue, a best response-based PG Corrector is designed. In the Corrector, the action deviation between the ego vehicle prediction and the surrounding agent actual behaviors are measured and are fed back to the ego vehicle decision-making, to correct the prediction errors caused by the inaccurate predefined cost functions and to improve the ego vehicle strategies. Distinguished from most existing game-theoretic approaches, this PCPG 1) deals with multi-player games and guarantees the existence of a pure-strategy Nash equilibrium (PSNE), convergence of the PSNE seeking algorithm, and global optimality of the derived PSNE when multiple PSNE exist; 2) is computationally scalable in a multi-agent scenario; 3) guarantees the ego vehicle safety under certain conditions; and 4) approximates the actual PSNE of the system despite the unknown cost functions of others. Comparative studies between the PG, the PCPG, and the control barrier function (CBF) based approaches are conducted in diverse traffic scenarios, including oncoming traffic scenario and multi-vehicle intersection-crossing scenario.

Autonomous Racing with AutoRally Vehicles and Differential Games

An MPC-based Controller Framework for Agile Maneuvering of Autonomous Vehicles.

A Shared Control Approach for Autonomous Vehicles via Driver Behaviors Learning

Game-Theoretic Model Predictive Control with Data-Driven Identification of Vehicle Model for Head-to-Head Autonomous Racing

Cooperative Path Following Control in Autonomous Vehicles Graphical Games: A Data-Based Off-Policy Learning Approach

Robust Model Predictive Path Integral Control: Analysis and Performance Guarantees

AutoRally An open platform for aggressive autonomous driving

Information Theoretic Model Predictive Control: Theory and Applications to Autonomous Driving

Active Exploration in Iterative Gaussian Process Regression for Uncertainty Modeling in Autonomous Racing

Information-Theoretic Model Predictive Control: Theory and Applications to Autonomous Driving

Formula RL: Deep Reinforcement Learning for Autonomous Racing using Telemetry Data

Pay Attention to How You Drive: Safe and Adaptive Model-Based Reinforcement Learning for Off-Road Driving

BayesRace: Learning to race autonomously using prior experience

Double-Iterative Gaussian Process Regression for Modeling Error Compensation in Autonomous Racing

Driving Conflict Resolution of Autonomous Vehicles at Unsignalized Intersections: A Differential Game Approach

Gaussian Process-based Stochastic Model Predictive Control for Overtaking in Autonomous Racing

Outracing Human Racers with Model-based Planning and Control for Time-trial Racing

Iterative Semi-parametric Dynamics Model Learning For Autonomous Racing

Competitive Driving of Autonomous Vehicles

Safe and Human-Like Autonomous Driving: A Predictor-Corrector Potential Game Approach

Learning How to Autonomously Race a Car: a Predictive Control Approach