Abstract:Considering that human-driven vehicles and autonomous vehicles (AVs) will coexist on roads in the future for a long time, how to merge AVs into human drivers' traffic ecology and minimize the effect of AVs and their misfit with human drivers, are issues worthy of consideration. Moreover, different passengers have different needs for AVs, thus, how to provide personalized choices for different passengers is another issue for AVs. Therefore, a human-like decision making framework is designed for AVs in this paper. Different driving styles and social interaction characteristics are formulated for AVs regarding driving safety, ride comfort and travel efficiency, which are considered in the modeling process of decision making. Then, Nash equilibrium and Stackelberg game theory are applied to the noncooperative decision making. In addition, potential field method and model predictive control (MPC) are combined to deal with the motion prediction and planning for AVs, which provides predicted motion information for the decision-making module. Finally, two typical testing scenarios of lane change, i.e., merging and overtaking, are carried out to evaluate the feasibility and effectiveness of the proposed decision-making framework considering different human-like behaviors. Testing results indicate that both the two game theoretic approaches can provide reasonable human-like decision making for AVs. Compared with the Nash equilibrium approach, under the normal driving style, the cost value of decision making using the Stackelberg game theoretic approach is reduced by over 20%.

Safe Planning with Game-Theoretic Formulation, Reachability Analysis and Reinforcement Learning

On Infusing Reachability-Based Safety Assurance within Probabilistic Planning Frameworks for Human-Robot Vehicle Interactions

On Infusing Reachability-Based Safety Assurance within Planning Frameworks for Human-Robot Vehicle Interactions

Drive with Quantified Risk: A Probabilistic Approach for Occlusion-Aware Trajectory Planning

Hierarchical Game-Theoretic Planning for Autonomous Vehicles

A Multi-Vehicle Game-Theoretic Framework for Decision Making and Planning of Autonomous Vehicles in Mixed Traffic

A Holistic Safe Planner for Automated Driving Considering Interaction with Human Drivers

Infusing Reachability-Based Safety into Planning and Control for Multi-agent Interactions

Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers

Game-Theory in Practice: Application to Motion Planning and Decision Making in an Autonomous Shuttle Bus

A Multi-Agent Reinforcement Learning Approach For Safe and Efficient Behavior Planning Of Connected Autonomous Vehicles

Planning for Safe Abortable Overtaking Maneuvers in Autonomous Driving

An Optimal Control Framework for Influencing Human Driving Behavior in Mixed-Autonomy Traffic

Game-Theoretic Adversarial Interaction-Based Critical Scenario Generation for Autonomous Vehicles

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

Solution Concepts in Hierarchical Games under Bounded Rationality with Applications to Autonomous Driving

Learning Responsibility Allocations for Safe Human-Robot Interaction with Applications to Autonomous Driving

Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach

Safe-by-Construction Autonomous Vehicle Overtaking using Control Barrier Functions and Model Predictive Control

Towards Tactical Behaviour Planning Under Uncertainties For Automated Vehicles In Urban Scenarios

Towards Safe Motion Planning for Autonomous Driving in Highway