Abstract:Trajectory planning method is a research hotspot in autonomous driving. Existing reinforcement learning-based trajectory planning methods suffer from unstable performance due to the strong randomness of network weight parameter updates during the training process. Therefore, this paper proposes a novel trajectory planning method based on deep reinforcement learning trust region policy optimization (TRPO). Firstly, in order to enhance the robustness of the trajectory planning method based on deep reinforcement learning TRPO, a TRPO-LSTM based decision model was proposed. More specifically, a long short term memory (LSTM) based state feature extraction network was designed and embeded into a TRPO-based decision model to enhance the ability of TRPO to extract information from the environmental state space. Secondly, in order to make the planned trajectory adaptive to the dynamic changes of traffic environment, we presented a novel TRPO-LSTM trajectory fitting algorithm. To the best of our knowledge, this is the first work aiming at applying the TRPO-LSTM based decision model in the trajectory fitting process to search the optimal longitudinal trajectory speed. Finally, the proposed trajectory planning method was implemented and simulated on the CARLA simulator. The experimental results show that, compared with existing trajectory planning methods based on deep reinforcement learning algorithms, our proposed method achieves a cumulative reward improvement of over 28.9% in the scenario of four lane highway, and has better robustness. Meanwhile, the proposed method can achieve a lower collision rate of 0.93% while improving the average speed and comfort of vehicle driving.

Real-time Trajectory Planning for Hypersonic Entry Flight Via Curriculum Reinforcement Learning

A Novel Trajectory Planning Method Based on Trust Region Policy Optimization

Deep Reinforcement Learning Based Trajectory Real-Time Planning for Hypersonic Gliding Vehicles

PEP: Policy-Embedded Trajectory Planning for Autonomous Driving

Real-time adaptive entry trajectory generation with modular policy and deep reinforcement learning

Demonstration Data-Driven Parameter Adjustment for Trajectory Planning in Highly Constrained Environments

Online Trajectory Planning Method for Midcourse Guidance Phase Based on Deep Reinforcement Learning

Trajectory Planning for Hypersonic Vehicles with Reinforcement Learning

Trajectory Planning for Airborne Radar in Extended Target Tracking Based on Deep Reinforcement Learning

A deep reinforcement learning-based approach to onboard trajectory generation for hypersonic vehicles

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Trajectory Planning and Prediction Guidance Based on the Moon-Earth Return Reentry Dynamics

Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning

Reinforcement Learning Based Trajectory Planning for Autonomous Vehicles

Trajectory Planning with Deep Reinforcement Learning in High-Level Action Spaces

Memory-Enhanced Twin Delayed Deep Deterministic Policy Gradient (ME-TD3)-Based Unmanned Combat Aerial Vehicle Trajectory Planning for Avoiding Radar Detection Threats in Dynamic and Unknown Environments

Multitask-constrained reentry trajectory planning for hypersonic gliding vehicle

Rapid Constrained Trajectory Planning for Entry Vehicles

Real-time Trajectory Planning for Free-Floating Space Robot in Close Range Using Continuous Thrust

Trajectory Planning for Teleoperated Space Manipulators Using Deep Reinforcement Learning

Learning-Initialized Trajectory Planning in Unknown Environments