Abstract:Adaptive cruise control and autonomous lane-change systems represent pivotal advancements in intelligent vehicle technology. To enhance the operational efficiency of intelligent vehicles in combined lane-change and car-following scenarios, we propose a coordinated decision control model based on hierarchical time series prediction and deep reinforcement learning under the influence of multiple surrounding vehicles. Firstly, we analyze the lane-change behavior and establish boundary conditions for safe lane-change, and divide the lane-change trajectory planning problem into longitudinal velocity planning and lateral trajectory planning. LSTM network is introduced to predict the driving states of surrounding vehicles in multi-step time series, combining D3QN algorithm to make decisions on lane-change behavior. Secondly, based on the following state between the ego vehicle and the leader vehicle in the initial lane, as well as the relationship between the initial distance and the expected distance with the leader vehicle in the target lane, with the primary objective of maximizing driving efficiency, longitudinal velocity is planned based on driving conditions recognition. The lateral trajectory and conditions recognition are then planned using the GA-LSTM-BP algorithm. In contrast to conventional adaptive cruise control systems, the DDPG algorithm serves as the lower-level control model for car-following, enabling continuous velocity control. The proposed model is subsequently simulated and validated using the NGSIM dataset and a lane-change scenarios dataset. The results demonstrate that the algorithm facilitates intelligent vehicle lane-change and car-following coordinated control while ensuring safety and stability during lane-changes. Comparative analysis with other decision control models reveals a notable 17.58% increase in driving velocity, underscoring the algorithm's effectiveness in improving driving efficiency.

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve This paper aims to address the issue of how intelligent vehicles can achieve efficient, safe, and stable collaborative control during lane changing and car-following processes. Specifically, the paper proposes a hierarchical lane-changing and car-following collaborative decision control model based on time series prediction and deep reinforcement learning to improve driving efficiency. ### Main Research Content 1. **Model Construction**: - **Hierarchical Lane-Changing and Car-Following Collaborative Decision Control Model**: The lane-changing trajectory planning problem is decomposed into longitudinal speed planning and lateral trajectory planning, and trajectory planning is performed based on driving condition recognition. - **Multi-Step Time Series Prediction Information**: An LSTM network is introduced to predict the future driving states of surrounding vehicles, providing a basis for lane-changing decisions and trajectory planning. - **Three-Layer Safety Assurance Mechanism**: A safety assurance mechanism is constructed for the decision layer, planning layer, and control layer to ensure the safety of the entire lane-changing and car-following process. - **Training Scenario Construction**: Lane-changing data from the NGSIM dataset is extracted to establish a lane-changing scenario dataset, improving the realism and complexity of the training environment and verifying the effectiveness of the model. 2. **Lane-Changing Behavior Analysis**: - Analyze the impact of the motion states of surrounding vehicles on lane-changing behavior, considering various traffic factors. - Establish lane-changing scenarios involving multiple vehicle influences, including the ego vehicle (Ego M), the preceding vehicle in the original lane (Mf), the preceding vehicle in the target lane (Lf), and the following vehicle in the target lane (Lr). - Determine the safety constraints during the lane-changing process to ensure sufficient safety distance from surrounding vehicles during lane changes. 3. **Framework Overview**: - **Decision Layer**: Includes the time series prediction module and lane-changing decision module. The LSTM network processes the time series information of surrounding vehicles and the ego vehicle, performs multi-step time series prediction, and inputs the results into the D3QN algorithm. - **Planning Layer**: Uses a GA-LSTM-BP neural network, improved by a genetic algorithm, for lateral and longitudinal planning, achieving driving condition recognition and lane-changing time prediction. - **Low-Level Control Module**: Employs the DDPG algorithm to implement car-following actions under different driving conditions, ensuring the safety of lane-changing and car-following. 4. **Lane-Changing Decision Model**: - **Time Series Prediction Module**: Uses the LSTM network to predict the future motion states of surrounding vehicles, determine the optimal safe lane-changing interval, and plan a safe and effective lane-changing trajectory. - **Lane-Changing Decision Based on Time Series Prediction and Deep Reinforcement Learning**: Utilizes the D3QN algorithm for lane-changing decisions, combining the current state and time series prediction information to generate decision results. ### Conclusion Through simulation and validation, the paper demonstrates the effectiveness of the proposed model in improving driving efficiency and ensuring the safety of lane-changing and car-following. Compared to traditional methods, this model increases driving speed by 17.58%, significantly enhancing driving efficiency.

Coordinated Decision Control of Lane-Change and Car-Following for Intelligent Vehicle Based on Time Series Prediction and Deep Reinforcement Learning

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

A Dynamic Trajectory Planning Method for Lane-Changing Maneuver of Connected and Automated Vehicles

Deep Reinforcement Learning Lane-Changing Decision Algorithm for Intelligent Vehicles Combining LSTM Trajectory Prediction

An Improved Hierarchical Deep Reinforcement Learning Algorithm for Multi-Intelligent Vehicle Lane Change

Hierarchical Lane-Changing Control for Vehicle Platoons in Prescribed Performance

Deep Reinforcement Learning Car-Following Control Based on Multivehicle Motion Prediction

Combining Decision Making and Trajectory Planning for Lane Changing Using Deep Reinforcement Learning

Model Predictive Adaptive Cruise Control of Intelligent Electric Vehicles Based on Deep Reinforcement Learning Algorithm FWOR Driver Characteristics

A Novel Dynamic Lane-Changing Trajectory Planning Model for Automated Vehicles Based on Reinforcement Learning

A Novel Lane-Change Decision-Making With Long-Time Trajectory Prediction for Autonomous Vehicle

A Human-Like Free-Lane-Change Trajectory Planning and Control Method With Data-Based Behavior Decision

Longitudinal control of automated vehicles: A novel approach by integrating deep reinforcement learning with intelligent driver model

Integrated eco-driving automation of intelligent vehicles in multi-lane scenario via model-accelerated reinforcement learning

Human-like Decision Making for Autonomous Lane Changing Using Deep Learning

A Novel Vehicle Platoon Following Controller Based on Deep Deterministic Policy Gradient Algorithms

Cooperation-Aware Lane Change Maneuver in Dense Traffic based on Model Predictive Control with Recurrent Neural Network

Highway Discretionary Lane-change Decision and Control Using Model Predictive Control

Lane-Change Intention Estimation for Car-Following Control in Autonomous Driving

Personalized Adaptive Cruise Control with Deep Reinforcement Learning

A multi-agent reinforcement learning-based longitudinal and lateral control of CAVs to improve traffic efficiency in a mandatory lane change scenario