Abstract:Autonomous vehicles are expected to display human-like behavior, at least to the extent that their decisions can be intuitively understood by other road users. If this is not the case, the coexistence of manual and autonomous vehicles in a mixed environment might affect road user interactions negatively and might jeopardize road safety. To this end, it is highly important to design algorithms that are capable of analyzing human decision-making processes and of reproducing them. In this context, lane-change maneuvers have been studied extensively. However, not all potential scenarios have been considered, since most works have focused on highway rather than urban scenarios. We contribute to the field of research by investigating a particular urban traffic scenario in which an autonomous vehicle needs to determine the level of cooperation of the vehicles in the adjacent lane in order to proceed with a lane change. To this end, we present a game theory-based decision-making model for lane changing in congested urban intersections. The model takes as input driving-related parameters related to vehicles in the intersection before they come to a complete stop. We validated the model by relying on the Co-AutoSim simulator. We compared the prediction model outcomes with actual participant decisions, i.e., whether they allowed the autonomous vehicle to drive in front of them. The results are promising, with the prediction accuracy being 100% in all of the cases in which the participants allowed the lane change and 83.3% in the other cases. The false predictions were due to delays in resuming driving after the traffic light turned green.

Game-Theoretic Cooperative Lane Changing Using Data-Driven Models

A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars

Developing Smart Lane-changing Strategies for CAVs on Freeways based on MOBIL and Reinforcement Learning

A Q-learning Foresighted Approach to Ego-efficient Lane Changes of Connected and Automated Vehicles on Freeways.

Cooperative Lane Changing via Deep Reinforcement Learning.

Cooperative lane-changing in mixed traffic: a deep reinforcement learning approach

Multi-agent reinforcement learning for cooperative lane changing of connected and autonomous vehicles in mixed traffic

Pay to change lanes: A cooperative lane-changing strategy for connected/automated driving

Cooperative and Interaction-aware Driver Model for Lane Change Maneuver

Research on lane-changing decision and control of autonomous vehicles based on game theory

Decentralized Cooperative Lane Changing at Freeway Weaving Areas Using Multi-Agent Deep Reinforcement Learning

Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changing

Research on Lane Changing Game and Behavioral Decision Making Based on Driving Styles and Micro-Interaction Behaviors

Multi-vehicle dynamic interaction in autonomous driving: integrating game theory and the potential field method

Cooperative Path Following Control in Autonomous Vehicles Graphical Games: A Data-Based Off-Policy Learning Approach

Reinforcement Learning from Human Feedback for Lane Changing of Autonomous Vehicles in Mixed Traffic

Cooperative Decision Making of Lane-change for Automated Vehicles Considering Human-like Driving Characteristics

Automated Lane Change Strategy using Proximal Policy Optimization-based Deep Reinforcement Learning

A Game Theory-Based Approach for Modeling Autonomous Vehicle Behavior in Congested, Urban Lane-Changing Scenarios

Harmonious Lane Changing via Deep Reinforcement Learning

A Collaborative Scheduling Lane Changing Model for Intelligent Connected Vehicles Based on Deep Reinforcement Learning