Abstract:Trajectory planning method is a research hotspot in autonomous driving. Existing reinforcement learning-based trajectory planning methods suffer from unstable performance due to the strong randomness of network weight parameter updates during the training process. Therefore, this paper proposes a novel trajectory planning method based on deep reinforcement learning trust region policy optimization (TRPO). Firstly, in order to enhance the robustness of the trajectory planning method based on deep reinforcement learning TRPO, a TRPO-LSTM based decision model was proposed. More specifically, a long short term memory (LSTM) based state feature extraction network was designed and embeded into a TRPO-based decision model to enhance the ability of TRPO to extract information from the environmental state space. Secondly, in order to make the planned trajectory adaptive to the dynamic changes of traffic environment, we presented a novel TRPO-LSTM trajectory fitting algorithm. To the best of our knowledge, this is the first work aiming at applying the TRPO-LSTM based decision model in the trajectory fitting process to search the optimal longitudinal trajectory speed. Finally, the proposed trajectory planning method was implemented and simulated on the CARLA simulator. The experimental results show that, compared with existing trajectory planning methods based on deep reinforcement learning algorithms, our proposed method achieves a cumulative reward improvement of over 28.9% in the scenario of four lane highway, and has better robustness. Meanwhile, the proposed method can achieve a lower collision rate of 0.93% while improving the average speed and comfort of vehicle driving.

A Dynamic Mission Abort Policy for Transportation Systems with Stochastic Dependence by Deep Reinforcement Learning

A dynamic mission abort policy for the swarm executing missions and its solution method by tailored deep reinforcement learning

Failure risk management: adaptive performance control and mission abort decisions

Adaptive Mission Abort Planning Integrating Bayesian Parameter Learning

Joint Modeling of Loading and Mission Abort Policies for Systems Operating in Dynamic Environments

Mission Abort Policy Balancing the Uncompleted Mission Penalty and System Loss Risk

Optimal Condition-Based Parameter Learning and Mission Abort Decisions

Mission risk control via joint optimization of sampling and abort decisions

Joint Optimization of Mission Aborts and Allocation of Standby Components Considering Mission Loss

Optimal Mission Abort Policy with Multiple Abort Criteria for a Balanced System with Multi-State Components

Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning.

Activation delay and aborting policy minimizing expected losses in consecutive attempts having cumulative effect on mission success

Optimal Task Aborting Policy and Component Activation Delay in Consecutive Multi-Attempt Missions.

A Novel Trajectory Planning Method Based on Trust Region Policy Optimization

Optimizing Component Activation and Operation Aborting in Missions with Consecutive Attempts and Common Abort Command

Multi-criteria Mission Abort Policy for Systems Subject to Two-Stage Degradation Process

Risk Control of Mission-Critical Systems: Abort Decision-Makings Integrating Health and Age Conditions

Optimal Aborting Rule in Multi-Attempt Missions Performed by Multicomponent Systems.

Optimal Task Aborting and Sequencing in Time Constrained Multi-Task Multi-Attempt Missions

Mission Abort Policy in Heterogeneous Nonrepairable 1-out-of-n Warm Standby Systems

Optimal Mission Abort Policy for Systems Operating in a Random Environment