Abstract:Journal of Circuits, Systems and Computers, Ahead of Print. Current research on lane-changing for intelligent connected vehicles (ICVs) primarily focuses on the control of a single ICV. Even studies on cooperative lane-changing among multiple ICVs often use fixed control algorithms, which are difficult to adapt to constantly changing traffic conditions. This paper proposes a method based on the deep deterministic policy gradient (DDPG) model. The DDPG algorithm has strong generalization capabilities, enabling it to handle complex traffic scenarios. Combined with the design of innovative reward functions, it successfully achieves the control of cooperative lane-changing for multiple ICVs. The novelty of this model is mainly reflected in the implementation of multiple ICVs control and cooperative strategies through the design of a speed reward function. Specifically, when two or more ICVs come within a 15-m range, a collaborative strategy is implemented. In this strategy, the original speeds of the vehicles involved are replaced with their average speed. This average speed is then used to compute the velocity reward. Moreover, an additional headway reward is introduced when two vehicles are on the same lane with a distance of less than 10[math]m between them, further optimizing lane-changing decisions and enhancing driving efficiency. The innovative approach described in this paper has been validated through simulations in the highway-env simulation environment. The model's effectiveness was tested under various conditions, including different road densities and numbers of ICVs. Results indicate that with an increasing number of episodes, the model consistently enhances both the fleet's and each individual vehicle's average speed and steps. It also ensures that the headway is maintained within a desired range of 10–20[math]m. This paper showcases the potential applications of a new DDPG-based multi-networked vehicular cooperative lane-changing decision model across different scenarios. These findings provide important reference values for future research and development in intelligent transportation systems (ITS), particularly in optimizing vehicle cooperative behaviors and enhancing traffic efficiency. This paper emphasizes the model's potential to significantly impact the management and operation of future vehicular networks, paving the way for more sophisticated and efficient transportation systems.

Cooperative vehicle platoon control considering longitudinal and lane-changing dynamics*

Dynamic Cooperative Vehicle Platoon Control Considering Longitudinal and Lane-changing Dynamics

Cooperative Distributed Predictive Control for Collision-Free Vehicle Platoons

A Dynamic Trajectory Planning Method for Lane-Changing Maneuver of Connected and Automated Vehicles

Hierarchical Lane-Changing Control for Vehicle Platoons in Prescribed Performance

Optimal Control-Based Online Motion Planning For Cooperative Lane Changes Of Connected And Automated Vehicles

Balancing Computation Speed and Quality: A Decentralized Motion Planning Method for Cooperative Lane Changes of Connected and Automated Vehicles.

Cooperative Lane‐Changing Control for CAVs at Freeway On‐Ramps considering Vehicle Dynamics

Cooperative lane-changing for connected autonomous vehicles merging into dedicated lanes in mixed traffic flow

Multivehicle Cooperative Lane Change Control Strategy for Intelligent Connected Vehicle

Cooperative Lane-Change Motion Planning for Connected and Automated Vehicle Platoons in Multi-Lane Scenarios

Cooperative platoon control for a mixed traffic flow including human drive vehicles and connected and autonomous vehicles

Distributed Cooperative Control and Optimization of Connected Automated Vehicles Platoon Against Cut-in Behaviors of Social Drivers

Distributed MPC of Vehicle Platoons Considering Longitudinal and Lateral Coupling

Cooperative Lane-Change Control Method for Freeways Considering Dynamic Intelligent Connected Dedicated Lanes

Combined Longitudinal and Lateral Control for Heterogeneous Nodes in Mixed Vehicle Platoon under V2I Communication

Cooperative Adaptive Cruise Control for a Platoon of Connected and Autonomous Vehicles considering Dynamic Information Flow Topology

Trajectory Planner for Platoon Lane Change *

Coordinated Control of CAVs for Platooning under a Parallel Distributed Model Predictive Control Framework

Motion control of connected and automated vehicles in a lane‐changing scenario with guaranteed tracking performance

Enhancing Cooperative Lane-Changing for Intelligent Connected Vehicles: A DDPG-Based Approach