Abstract:Journal of Circuits, Systems and Computers, Ahead of Print. Current research on lane-changing for intelligent connected vehicles (ICVs) primarily focuses on the control of a single ICV. Even studies on cooperative lane-changing among multiple ICVs often use fixed control algorithms, which are difficult to adapt to constantly changing traffic conditions. This paper proposes a method based on the deep deterministic policy gradient (DDPG) model. The DDPG algorithm has strong generalization capabilities, enabling it to handle complex traffic scenarios. Combined with the design of innovative reward functions, it successfully achieves the control of cooperative lane-changing for multiple ICVs. The novelty of this model is mainly reflected in the implementation of multiple ICVs control and cooperative strategies through the design of a speed reward function. Specifically, when two or more ICVs come within a 15-m range, a collaborative strategy is implemented. In this strategy, the original speeds of the vehicles involved are replaced with their average speed. This average speed is then used to compute the velocity reward. Moreover, an additional headway reward is introduced when two vehicles are on the same lane with a distance of less than 10[math]m between them, further optimizing lane-changing decisions and enhancing driving efficiency. The innovative approach described in this paper has been validated through simulations in the highway-env simulation environment. The model's effectiveness was tested under various conditions, including different road densities and numbers of ICVs. Results indicate that with an increasing number of episodes, the model consistently enhances both the fleet's and each individual vehicle's average speed and steps. It also ensures that the headway is maintained within a desired range of 10–20[math]m. This paper showcases the potential applications of a new DDPG-based multi-networked vehicular cooperative lane-changing decision model across different scenarios. These findings provide important reference values for future research and development in intelligent transportation systems (ITS), particularly in optimizing vehicle cooperative behaviors and enhancing traffic efficiency. This paper emphasizes the model's potential to significantly impact the management and operation of future vehicular networks, paving the way for more sophisticated and efficient transportation systems.

Intelligent Collaborative Driving Lane Changing Decision of Multi-Intelligent Connected Vehicles

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

Developing Smart Lane-changing Strategies for CAVs on Freeways based on MOBIL and Reinforcement Learning

A Q-learning Foresighted Approach to Ego-efficient Lane Changes of Connected and Automated Vehicles on Freeways.

Characteristics of Mixed Traffic Flow in Two-lane Scenario Based on Cooperative Gaming Method

A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars

Enhancing Cooperative Lane-Changing for Intelligent Connected Vehicles: A DDPG-Based Approach

An Improved Hierarchical Deep Reinforcement Learning Algorithm for Multi-Intelligent Vehicle Lane Change

A Collaborative Scheduling Lane Changing Model for Intelligent Connected Vehicles Based on Deep Reinforcement Learning

An Intelligent Lane Changing Decision Method for Connected Vehicles.

Multi-Agent DRL-Based Lane Change with Right-of-Way Collaboration Awareness

Research on decision-making of lane-changing of automated vehicles in highway confluence area based on deep reinforcement learning

Discretionary Lane Change Model for Intelligent Connected Vehicles on Expressway

Cooperative Lane-Change Control Method for Freeways Considering Dynamic Intelligent Connected Dedicated Lanes

Mix Q-learning for Lane Changing: A Collaborative Decision-Making Method in Multi-Agent Deep Reinforcement Learning

Decentralized Cooperative Lane-Changing Decision-Making for Connected Autonomous Vehicles

Collaborative Overtaking Strategy for Enhancing Overall Effectiveness of Mixed Connected and Connectionless Vehicles

A multi-agent reinforcement learning-based longitudinal and lateral control of CAVs to improve traffic efficiency in a mandatory lane change scenario

Coordinated Decision Control of Lane-Change and Car-Following for Intelligent Vehicle Based on Time Series Prediction and Deep Reinforcement Learning

Modeling and Simulation of Indirect Reciprocity Based Cooperative Lane-Changing at the Intersection in Connected Vehicle Environment

Cooperative lane-changing in mixed traffic: a deep reinforcement learning approach