Abstract:Trajectory planning method is a research hotspot in autonomous driving. Existing reinforcement learning-based trajectory planning methods suffer from unstable performance due to the strong randomness of network weight parameter updates during the training process. Therefore, this paper proposes a novel trajectory planning method based on deep reinforcement learning trust region policy optimization (TRPO). Firstly, in order to enhance the robustness of the trajectory planning method based on deep reinforcement learning TRPO, a TRPO-LSTM based decision model was proposed. More specifically, a long short term memory (LSTM) based state feature extraction network was designed and embeded into a TRPO-based decision model to enhance the ability of TRPO to extract information from the environmental state space. Secondly, in order to make the planned trajectory adaptive to the dynamic changes of traffic environment, we presented a novel TRPO-LSTM trajectory fitting algorithm. To the best of our knowledge, this is the first work aiming at applying the TRPO-LSTM based decision model in the trajectory fitting process to search the optimal longitudinal trajectory speed. Finally, the proposed trajectory planning method was implemented and simulated on the CARLA simulator. The experimental results show that, compared with existing trajectory planning methods based on deep reinforcement learning algorithms, our proposed method achieves a cumulative reward improvement of over 28.9% in the scenario of four lane highway, and has better robustness. Meanwhile, the proposed method can achieve a lower collision rate of 0.93% while improving the average speed and comfort of vehicle driving.

Sub-trajectory clustering with deep reinforcement learning

A Novel Trajectory Planning Method Based on Trust Region Policy Optimization

A Deep Trajectory Clustering Method Based on Sequence‐to‐sequence Autoencoder Model

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

A Deep Spatiotemporal Trajectory Representation Learning Framework for Clustering

DRL-Based Trajectory Tracking for Motion-Related Modules in Autonomous Driving

Single-Trajectory Distributionally Robust Reinforcement Learning

Clustered Reinforcement Learning

Trajectory clustering: a partition-and-group framework

Deep Reinforcement Clustering

A Dual Self-supervised Deep Trajectory Clustering Method.

Discovering Behavioral Modes in Deep Reinforcement Learning Policies Using Trajectory Clustering in Latent Space

Free from Bellman Completeness: Trajectory Stitching via Model-based Return-conditioned Supervised Learning

Trajectory Planning with Deep Reinforcement Learning in High-Level Action Spaces

Joint Cluster Head Selection and Trajectory Planning in UAV-Aided IoT Networks by Reinforcement Learning with Sequential Model

Deep reinforcement learning for unmanned aerial vehicles cluster task allocation

Reinforcement Learning in a Safety-Embedded MDP with Trajectory Optimization

A Hierarchical Hybrid Learning Framework for Multi-Agent Trajectory Prediction

Online Trajectory Planning Method for Midcourse Guidance Phase Based on Deep Reinforcement Learning

Trajectory tracking control based on deep reinforcement learning and ensemble random network distillation for robotic manipulator