Abstract:Adaptive cruise control and autonomous lane-change systems represent pivotal advancements in intelligent vehicle technology. To enhance the operational efficiency of intelligent vehicles in combined lane-change and car-following scenarios, we propose a coordinated decision control model based on hierarchical time series prediction and deep reinforcement learning under the influence of multiple surrounding vehicles. Firstly, we analyze the lane-change behavior and establish boundary conditions for safe lane-change, and divide the lane-change trajectory planning problem into longitudinal velocity planning and lateral trajectory planning. LSTM network is introduced to predict the driving states of surrounding vehicles in multi-step time series, combining D3QN algorithm to make decisions on lane-change behavior. Secondly, based on the following state between the ego vehicle and the leader vehicle in the initial lane, as well as the relationship between the initial distance and the expected distance with the leader vehicle in the target lane, with the primary objective of maximizing driving efficiency, longitudinal velocity is planned based on driving conditions recognition. The lateral trajectory and conditions recognition are then planned using the GA-LSTM-BP algorithm. In contrast to conventional adaptive cruise control systems, the DDPG algorithm serves as the lower-level control model for car-following, enabling continuous velocity control. The proposed model is subsequently simulated and validated using the NGSIM dataset and a lane-change scenarios dataset. The results demonstrate that the algorithm facilitates intelligent vehicle lane-change and car-following coordinated control while ensuring safety and stability during lane-changes. Comparative analysis with other decision control models reveals a notable 17.58% increase in driving velocity, underscoring the algorithm's effectiveness in improving driving efficiency.

Human-like Decision Making for Autonomous Lane Changing Using Deep Learning

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars

Human-like decision making for lane change based on the cognitive map and hierarchical reinforcement learning

Personalized Lane Change Decision Algorithm Using Deep Reinforcement Learning Approach.

Deep Reinforcement Learning Lane-Changing Decision Algorithm for Intelligent Vehicles Combining LSTM Trajectory Prediction

An Improved Hierarchical Deep Reinforcement Learning Algorithm for Multi-Intelligent Vehicle Lane Change

Brain-Inspired Modeling and Decision-Making for Human-Like Autonomous Driving in Mixed Traffic Environment

A Novel Lane-Change Decision-Making With Long-Time Trajectory Prediction for Autonomous Vehicle

Coordinated Decision Control of Lane-Change and Car-Following for Intelligent Vehicle Based on Time Series Prediction and Deep Reinforcement Learning

A Human-Like Free-Lane-Change Trajectory Planning and Control Method With Data-Based Behavior Decision

Game-Theoretic Lane Change Decision-Making Method Considering Traffic Trend

Research on decision-making of lane-changing of automated vehicles in highway confluence area based on deep reinforcement learning

Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles

Combining Decision Making and Trajectory Planning for Lane Changing Using Deep Reinforcement Learning

Brain-Inspired Modelling and Decision-making for Human-Like Autonomous Driving in Mixed Traffic Environment

Reinforcement Learning from Human Feedback for Lane Changing of Autonomous Vehicles in Mixed Traffic

Deep Reinforcement Learning Based Decision-Making Strategy of Autonomous Vehicle in Highway Uncertain Driving Environments

Driver Lane Change Intention Recognition of Intelligent Vehicle Based on Long Short-Term Memory Network

Machine Learning-Based Vehicle Intention Trajectory Recognition and Prediction for Autonomous Driving

Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment