Abstract:Intelligent decisions for autonomous lane-changing in vehicles have consistently been a focal point of research in the industry. Traditional lane-changing algorithms, which rely on predefined rules, are ill-suited for the complexities and variabilities of real-world road conditions. In this study, we propose an algorithm that leverages the deep deterministic policy gradient (DDPG) reinforcement learning, integrated with a long short-term memory (LSTM) trajectory prediction model, termed as LSTM-DDPG. In the proposed LSTM-DDPG model, the LSTM state module transforms the observed values from the observation module into a state representation, which then serves as a direct input to the DDPG actor network. Meanwhile, the LSTM prediction module translates the historical trajectory coordinates of nearby vehicles into a word-embedding vector via a fully connected layer, thus providing predicted trajectory information for surrounding vehicles. This integrated LSTM approach considers the potential influence of nearby vehicles on the lane-changing decisions of the subject vehicle. Furthermore, our study emphasizes the safety, efficiency, and comfort of the lane-changing process. Accordingly, we designed a reward and penalty function for the LSTM-DDPG algorithm and determined the optimal network structure parameters. The algorithm was then tested on a simulation platform built with MATLAB/Simulink. Our findings indicate that the LSTM-DDPG model offers a more realistic representation of traffic scenarios involving vehicle interactions. When compared to the traditional DDPG algorithm, the LSTM-DDPG achieved a 7.4% increase in average single-step rewards after normalization, underscoring its superior performance in enhancing lane-changing safety and efficiency. This research provides new ideas for advanced lane-changing decisions in autonomous vehicles.

Autonomous Lane Change Decision Making Using Different Deep Reinforcement Learning Methods

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

DRNet: A Decision-Making Method for Autonomous Lane Changingwith Deep Reinforcement Learning

A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars

An Intelligent Lane Changing Decision Method for Connected Vehicles.

A Safe and Efficient Lane Change Decision-Making Strategy of Autonomous Driving Based on Deep Reinforcement Learning

Personalized Lane Change Decision Algorithm Using Deep Reinforcement Learning Approach.

Automated Lane Change Strategy using Proximal Policy Optimization-based Deep Reinforcement Learning

A Comparative Analysis of Deep Reinforcement Learning-Enabled Freeway Decision-Making for Automated Vehicles

Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment

Research on Autonomous Driving Decision-making Strategies based Deep Reinforcement Learning

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Mix Q-learning for Lane Changing: A Collaborative Decision-Making Method in Multi-Agent Deep Reinforcement Learning

An Improved Hierarchical Deep Reinforcement Learning Algorithm for Multi-Intelligent Vehicle Lane Change

Autonomous Motion Decision-making based on Deep Reinforcement Learning for Autonomous Driving

Deep Reinforcement Learning Lane-Changing Decision Algorithm for Intelligent Vehicles Combining LSTM Trajectory Prediction

Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changing

Combining Decision Making and Trajectory Planning for Lane Changing Using Deep Reinforcement Learning

Cooperative lane-changing in mixed traffic: a deep reinforcement learning approach

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller