Abstract:Journal of Circuits, Systems and Computers, Ahead of Print. Current research on lane-changing for intelligent connected vehicles (ICVs) primarily focuses on the control of a single ICV. Even studies on cooperative lane-changing among multiple ICVs often use fixed control algorithms, which are difficult to adapt to constantly changing traffic conditions. This paper proposes a method based on the deep deterministic policy gradient (DDPG) model. The DDPG algorithm has strong generalization capabilities, enabling it to handle complex traffic scenarios. Combined with the design of innovative reward functions, it successfully achieves the control of cooperative lane-changing for multiple ICVs. The novelty of this model is mainly reflected in the implementation of multiple ICVs control and cooperative strategies through the design of a speed reward function. Specifically, when two or more ICVs come within a 15-m range, a collaborative strategy is implemented. In this strategy, the original speeds of the vehicles involved are replaced with their average speed. This average speed is then used to compute the velocity reward. Moreover, an additional headway reward is introduced when two vehicles are on the same lane with a distance of less than 10[math]m between them, further optimizing lane-changing decisions and enhancing driving efficiency. The innovative approach described in this paper has been validated through simulations in the highway-env simulation environment. The model's effectiveness was tested under various conditions, including different road densities and numbers of ICVs. Results indicate that with an increasing number of episodes, the model consistently enhances both the fleet's and each individual vehicle's average speed and steps. It also ensures that the headway is maintained within a desired range of 10–20[math]m. This paper showcases the potential applications of a new DDPG-based multi-networked vehicular cooperative lane-changing decision model across different scenarios. These findings provide important reference values for future research and development in intelligent transportation systems (ITS), particularly in optimizing vehicle cooperative behaviors and enhancing traffic efficiency. This paper emphasizes the model's potential to significantly impact the management and operation of future vehicular networks, paving the way for more sophisticated and efficient transportation systems.

Cooperative driving and lane changing at blind crossings

Cooperative Driving at Lane Closures

A Bi-Level Cooperative Driving Strategy Allowing Lane Changes

Cooperative Lane-Change Maneuver for Multiple Automated Vehicles on a Highway

Cooperative Same-direction Automated Lane-changing Based on Vehicle-to-vehicle Communication

A Cooperative Lane Change Model for Connected and Automated Vehicles.

Cooperation Method of Connected and Automated Vehicles at Unsignalized Intersections: Lane Changing and Arrival Scheduling

Multivehicle Cooperative Lane Change Control Strategy for Intelligent Connected Vehicle

A Cooperation-Aware Lane Change Method for Automated Vehicles

Selection-sort-based cooperative driving strategy for CAVs at non-signalized intersections

Dynamic Cooperative Automated Lane-Change Maneuver Based on Minimum Safety Spacing Model

Cooperative Driving of Connected Autonomous Vehicles in Heterogeneous Mixed Traffic: A Game Theoretic Approach

Model Predictive Control-Based Cooperative Lane Change Strategy For Improving Traffic Flow

Cooperative Lane Changing Strategies to Improve Traffic Operation and Safety Nearby Freeway Off-Ramps in a Connected and Automated Vehicles Environment

A Dynamic Automated Lane Change Maneuver Based on Vehicle-To-Vehicle Communication

A Cooperative Control Framework for CAV Lane Change in a Mixed Traffic Environment

A Homogeneous Multi-Vehicle Cooperative Group Decision-Making Method in Complicated Mixed Traffic Scenarios

A real-time optimal cooperative lane change strategy via V2V communication

Cooperative Driving at Unsignalized Intersections Using Tree Search

Distributed Cooperative Driving Strategy for Connected Automated Vehicles at Unsignalized Intersections Based on Monte Carlo Method

Enhancing Cooperative Lane-Changing for Intelligent Connected Vehicles: A DDPG-Based Approach