Hierarchical Game-Theoretic Planning for Autonomous Vehicles

Jaime F. Fisac,Eli Bronstein,Elis Stefansson,Dorsa Sadigh,S. Shankar Sastry,Anca D. Dragan
DOI: https://doi.org/10.48550/arXiv.1810.05766
2018-10-13
Abstract:The actions of an autonomous vehicle on the road affect and are affected by those of other drivers, whether overtaking, negotiating a merge, or avoiding an accident. This mutual dependence, best captured by dynamic game theory, creates a strong coupling between the vehicle's planning and its predictions of other drivers' behavior, and constitutes an open problem with direct implications on the safety and viability of autonomous driving technology. Unfortunately, dynamic games are too computationally demanding to meet the real-time constraints of autonomous driving in its continuous state and action space. In this paper, we introduce a novel game-theoretic trajectory planning algorithm for autonomous driving, that enables real-time performance by hierarchically decomposing the underlying dynamic game into a long-horizon "strategic" game with simplified dynamics and full information structure, and a short-horizon "tactical" game with full dynamics and a simplified information structure. The value of the strategic game is used to guide the tactical planning, implicitly extending the planning horizon, pushing the local trajectory optimization closer to global solutions, and, most importantly, quantitatively accounting for the autonomous vehicle and the human driver's ability and incentives to influence each other. In addition, our approach admits non-deterministic models of human decision-making, rather than relying on perfectly rational predictions. Our results showcase richer, safer, and more effective autonomous behavior in comparison to existing techniques.
Robotics,Artificial Intelligence,Multiagent Systems,Optimization and Control
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to achieve safer and more effective driving behaviors in the interaction between autonomous vehicles and human drivers. Specifically, the paper focuses on situations such as overtaking, negotiating lane - changing or avoiding accidents, where the behavior of autonomous vehicles not only affects the behavior of other drivers but is also affected by these behaviors. This interdependence constitutes a dynamic game problem, which has a direct impact on the safety and feasibility of autonomous driving technology. However, dynamic game problems are difficult to meet the real - time requirements of autonomous driving due to their high computational complexity, especially in continuous state and action spaces. To address this challenge, the paper proposes a novel game - theoretic trajectory planning algorithm to achieve real - time performance by hierarchically decomposing the underlying dynamic game problem. This method consists of two main parts: 1. **Strategic Planner**: Responsible for determining the outcome of long - term interactions, using a simplified dynamic model and a fully coupled interaction structure. This planner can predict the interaction results within multiple seconds, thus providing guidance for tactical planning. 2. **Tactical Planner**: Based on a high - fidelity dynamic model, calculates short - term vehicle trajectories and simplifies the interaction structure. The tactical planner uses the long - term values calculated by the strategic planner as terminal cost terms to optimize short - term trajectories. In this way, this framework can more accurately capture the information structure between autonomous vehicles and other drivers while maintaining computational feasibility, thereby achieving more distant future predictions and improving the quality of trajectory optimization solutions. In addition, this method allows the use of non - deterministic human decision - making models instead of relying on perfectly rational predictions, which makes autonomous driving behaviors more diverse, safe and effective.