Abstract:This paper proposes a vehicle-parking trajectory planning method that addresses the issues of a long trajectory planning time and difficult training convergence during automatic parking. The process involves two stages: finding a parking space and parking planning. The first stage uses model predictive control (MPC) for trajectory tracking from the initial position of the vehicle to the starting point of the parking operation. The second stage employs the proximal policy optimization (PPO) algorithm to transform the parking behavior into a reinforcement learning process. A four-dimensional reward function is set to evaluate the strategy based on a formal reward, guiding the adjustment of neural network parameters and reducing the exploration of invalid actions. Finally, a simulation environment is built for the parking scene, and a network framework is designed. The proposed method is compared with the deep deterministic policy gradient and double-delay deep deterministic policy gradient algorithms in the same scene. Results confirm that the MPC controller accurately performs trajectory-tracking control with minimal steering wheel angle changes and smooth, continuous movement. The PPO-based reinforcement learning method achieves shorter learning times, totaling only 30% and 37.5% of the deep deterministic policy gradient (DDPG) and twin-delayed deep deterministic policy gradient (TD3), and the number of iterations to reach convergence for the PPO algorithm with the introduction of the four-dimensional evaluation metrics is 75% and 68% shorter compared to the DDPG and TD3 algorithms, respectively. This study demonstrates the effectiveness of the proposed method in addressing a slow convergence and long training times in parking trajectory planning, improving parking timeliness.

A DRL Based Cooperative Approach for Parking Space Allocation in an Automated Valet Parking System.

A Bi-Level Cooperative Operation Approach For Agv Based Automated Valet Parking

Human-Like Reverse Parking Using Deep Reinforcement Learning with Attention Mechanism

Deep Reinforcement Learning-Based Long-Range Autonomous Valet Parking for Smart Cities

Reinforcement Learning-Based Algorithm for Real-Time Automated Parking Decision Making.

Real-time Allocation of Shared Parking Spaces Based on Deep Reinforcement Learning

Conflict-constrained Multi-agent Reinforcement Learning Method for Parking Trajectory Planning.

Data Efficient Reinforcement Learning for Integrated Lateral Planning and Control in Automated Parking System

An Automatic Parking Model Based on Deep Reinforcement Learning

Mobile Parking Incentives for Vehicular Networks: a Deep Reinforcement Learning Approach

Path Planning and Tracking Control for Parking Via Soft Actor-Critic under Non-Ideal Scenarios

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

Model-Based Predictive Control and Reinforcement Learning for Planning Vehicle-Parking Trajectories for Vertical Parking Spaces

Dynamic coordinated strategy for parking guidance in a mixed driving parking lot involving human-driven and autonomous vehicles

Hybrid Residual Multiexpert Reinforcement Learning for Spatial Scheduling of High-Density Parking Lots

Autonomous Vehicles' Decision-Making Behavior in Complex Driving Environments Using Deep Reinforcement Learning

Automated Parking Planning with Vision-Based BEV Approach

Reservation Enhanced Autonomous Valet Parking Concerning Practicality Issues

Design of a reinforcement learning-based intelligent car transfer planning system for parking lots.

Deep reinforcement learning-based drift parking control of automated vehicles

Towards Driving and Parking Integration: A Holistic Planning Framework for Automated Valet Parking with Optimized Efficiency