Abstract:This paper proposes a vehicle-parking trajectory planning method that addresses the issues of a long trajectory planning time and difficult training convergence during automatic parking. The process involves two stages: finding a parking space and parking planning. The first stage uses model predictive control (MPC) for trajectory tracking from the initial position of the vehicle to the starting point of the parking operation. The second stage employs the proximal policy optimization (PPO) algorithm to transform the parking behavior into a reinforcement learning process. A four-dimensional reward function is set to evaluate the strategy based on a formal reward, guiding the adjustment of neural network parameters and reducing the exploration of invalid actions. Finally, a simulation environment is built for the parking scene, and a network framework is designed. The proposed method is compared with the deep deterministic policy gradient and double-delay deep deterministic policy gradient algorithms in the same scene. Results confirm that the MPC controller accurately performs trajectory-tracking control with minimal steering wheel angle changes and smooth, continuous movement. The PPO-based reinforcement learning method achieves shorter learning times, totaling only 30% and 37.5% of the deep deterministic policy gradient (DDPG) and twin-delayed deep deterministic policy gradient (TD3), and the number of iterations to reach convergence for the PPO algorithm with the introduction of the four-dimensional evaluation metrics is 75% and 68% shorter compared to the DDPG and TD3 algorithms, respectively. This study demonstrates the effectiveness of the proposed method in addressing a slow convergence and long training times in parking trajectory planning, improving parking timeliness.

An Automatic Parking Model Based on Deep Reinforcement Learning

Optimization-based Motion Planning for Autonomous Parking Considering Dynamic Obstacle: A Hierarchical Framework

Reinforcement Learning-Based End-to-End Parking for Automatic Parking System

Data Efficient Reinforcement Learning for Integrated Lateral Planning and Control in Automated Parking System

Reinforcement Learning-Based Algorithm for Real-Time Automated Parking Decision Making.

Deep reinforcement learning-based drift parking control of automated vehicles

A Guaranteed Collision‐free Trajectory Planning Method for Autonomous Parking

Model-Based Predictive Control and Reinforcement Learning for Planning Vehicle-Parking Trajectories for Vertical Parking Spaces

A Maximum Entropy Inverse Reinforcement Learning Algorithm for Automatic Parking

Design and Implementation of Deep Neural Network-Based Control for Automatic Parking Maneuver Process

Design of a reinforcement learning-based intelligent car transfer planning system for parking lots.

Master General Parking Skill Via Deep Learning

Real-time Allocation of Shared Parking Spaces Based on Deep Reinforcement Learning

Model-based Decision Making with Imagination for Autonomous Parking

Multi-Agent Car Parking using Reinforcement Learning

Autonomous Parking: A Unified Motion Planning Framework Based On Simultaneous Dynamic Optimization

Research on multi-directional automatic parking of Ackerman car model such as vertical parking, parallel parking and oblique parking

Nonlinear Model Predictive Lateral Control for Automated Parking System with Position and Attitude Coordination Control

Research on Automatic Parking Systems Based on Parking Scene Recognition

An Intelligent Parking Assist System

A Unified Motion Planning Method for Parking an Autonomous Vehicle in the Presence of Irregularly Placed Obstacles