Abstract:Adaptive cruise control and autonomous lane-change systems represent pivotal advancements in intelligent vehicle technology. To enhance the operational efficiency of intelligent vehicles in combined lane-change and car-following scenarios, we propose a coordinated decision control model based on hierarchical time series prediction and deep reinforcement learning under the influence of multiple surrounding vehicles. Firstly, we analyze the lane-change behavior and establish boundary conditions for safe lane-change, and divide the lane-change trajectory planning problem into longitudinal velocity planning and lateral trajectory planning. LSTM network is introduced to predict the driving states of surrounding vehicles in multi-step time series, combining D3QN algorithm to make decisions on lane-change behavior. Secondly, based on the following state between the ego vehicle and the leader vehicle in the initial lane, as well as the relationship between the initial distance and the expected distance with the leader vehicle in the target lane, with the primary objective of maximizing driving efficiency, longitudinal velocity is planned based on driving conditions recognition. The lateral trajectory and conditions recognition are then planned using the GA-LSTM-BP algorithm. In contrast to conventional adaptive cruise control systems, the DDPG algorithm serves as the lower-level control model for car-following, enabling continuous velocity control. The proposed model is subsequently simulated and validated using the NGSIM dataset and a lane-change scenarios dataset. The results demonstrate that the algorithm facilitates intelligent vehicle lane-change and car-following coordinated control while ensuring safety and stability during lane-changes. Comparative analysis with other decision control models reveals a notable 17.58% increase in driving velocity, underscoring the algorithm's effectiveness in improving driving efficiency.

Path tracking control based on Deep reinforcement learning in Autonomous driving

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Coordinated Decision Control of Lane-Change and Car-Following for Intelligent Vehicle Based on Time Series Prediction and Deep Reinforcement Learning

Learning to Drive Like Human Beings: A Method Based on Deep Reinforcement Learning

Autonomous Driving in the Uncertain Traffic——a Deep Reinforcement Learning Approach

Path-Tracking Control Strategy of Unmanned Vehicle Based on DDPG Algorithm

Autonomous Driving Control Using the DDPG and RDPG Algorithms

A Safe and Efficient Lane Change Decision-Making Strategy of Autonomous Driving Based on Deep Reinforcement Learning

Longitudinal control of automated vehicles: A novel approach by integrating deep reinforcement learning with intelligent driver model

Reinforcement Learning-Based High-Speed Path Following Control for Autonomous Vehicles

Combining Deep Reinforcement Learning and Safety Based Control for Autonomous Driving

End-to-End Deep Reinforcement Learning for Lane Keeping Assist

Reinforcement-learning-aided Adaptive Control for Autonomous Driving with Combined Lateral and Longitudinal Dynamics

Deep Reinforcement Learning Lane-Changing Decision Algorithm for Intelligent Vehicles Combining LSTM Trajectory Prediction

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning

A Learning-Based Nonlinear Model Predictive Control Approach for Autonomous Driving

Continuous Control for Automated Lane Change Behavior Based on Deep Deterministic Policy Gradient Algorithm

An Automatic Driving Control Method Based on Deep Deterministic Policy Gradient

Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network

Distributed Drive Autonomous Vehicle Trajectory Tracking Control Based on Multi-Agent Deep Reinforcement Learning