Abstract:Journal of Circuits, Systems and Computers, Ahead of Print. Current research on lane-changing for intelligent connected vehicles (ICVs) primarily focuses on the control of a single ICV. Even studies on cooperative lane-changing among multiple ICVs often use fixed control algorithms, which are difficult to adapt to constantly changing traffic conditions. This paper proposes a method based on the deep deterministic policy gradient (DDPG) model. The DDPG algorithm has strong generalization capabilities, enabling it to handle complex traffic scenarios. Combined with the design of innovative reward functions, it successfully achieves the control of cooperative lane-changing for multiple ICVs. The novelty of this model is mainly reflected in the implementation of multiple ICVs control and cooperative strategies through the design of a speed reward function. Specifically, when two or more ICVs come within a 15-m range, a collaborative strategy is implemented. In this strategy, the original speeds of the vehicles involved are replaced with their average speed. This average speed is then used to compute the velocity reward. Moreover, an additional headway reward is introduced when two vehicles are on the same lane with a distance of less than 10[math]m between them, further optimizing lane-changing decisions and enhancing driving efficiency. The innovative approach described in this paper has been validated through simulations in the highway-env simulation environment. The model's effectiveness was tested under various conditions, including different road densities and numbers of ICVs. Results indicate that with an increasing number of episodes, the model consistently enhances both the fleet's and each individual vehicle's average speed and steps. It also ensures that the headway is maintained within a desired range of 10–20[math]m. This paper showcases the potential applications of a new DDPG-based multi-networked vehicular cooperative lane-changing decision model across different scenarios. These findings provide important reference values for future research and development in intelligent transportation systems (ITS), particularly in optimizing vehicle cooperative behaviors and enhancing traffic efficiency. This paper emphasizes the model's potential to significantly impact the management and operation of future vehicular networks, paving the way for more sophisticated and efficient transportation systems.

A Probabilistic Approach to Driver Assistance for Delay Reduction at Congested Highway Lane Drops

Traffic Delay Reduction at Highway Diverges Using an Advance Warning System Based on a Probabilistic Prediction Model

Estimating the Probability that a Vehicle Reaches a Near-Term Goal State Using Multiple Lane Changes

Distributed cooperative trajectory and lane changing optimization of connected automated vehicles: Freeway segments with lane drop

A Learning-Based Approach for Lane Departure Warning Systems With a Personalized Driver Model

Risk-Aware Lane Selection on Highway with Dynamic Obstacles

Driver Digital Twin for Online Prediction of Personalized Lane Change Behavior

A Novel Method for Lane-change Maneuver in Urban Driving Using Predictive Markov Decision Process

Improving Traffic Efficiency With Lane Guidance Based on Desired Speeds

A Novel Model for Driver Lane Change Prediction in Cooperative Adaptive Cruise Control Systems

A probabilistic risk assessment framework considering lane-changing behavior interaction

Enhancing Cooperative Lane-Changing for Intelligent Connected Vehicles: A DDPG-Based Approach

Incorporating lane-change prediction into energy-efficient speed control of connected autonomous vehicles at intersections

Prediction of Highway Lane Changes Based on Prototype Trajectories

Game-Theoretic Lane Change Decision-Making Method Considering Traffic Trend

Cooperative Lane-Change Control Method for Freeways Considering Dynamic Intelligent Connected Dedicated Lanes

Driver Lane-Changing Behavior Prediction Based on Deep Learning

A novel collision avoidance strategy for highway overtaking considering the driver's steering intent

Gain‐scheduling control of dynamic lateral lane change for automated and connected vehicles based on the multipoint preview

A Lane Change Assistance System Based on Prediction of Driver Intention

Using Dual Attention BiLSTM to Predict Vehicle Lane Changing Maneuvers on Highway Dataset