Reinforcement Learning-Based Algorithm for Real-Time Automated Parking Decision Making.

Xiaoyi Wei,Taixian Hou,Xiao Zhao,Jiaxin Tu,Haiyang Guan,Peng Zhai,Lihua Zhang
DOI: https://doi.org/10.1007/978-981-99-9119-8_22
2024-01-01
Abstract:Recently, automated parking has gained attention for its ability to enhance parking accuracy and provide a comfortable experience for car owners. However, with the increasing number of vehicles in the parking lot, the traditional automatic parking algorithm face the dual challenges brought by narrow parking spaces and random vehicle obstacles. To address these issues, this paper proposes Curriculum Learning RL for automatic parking decision making in unregulated parking lots. Our approach involves SAC, a reinforcement learning (RL) algorithm, for curriculum learning, where the vehicle learns to park and avoid the obstacles separately through two courses. We incorporate a reward function that considers both location and safety, facilitating continuous learning of optimal actions. In addition, we develop a simulation platform for unregulated parking lots, and we train the algorithm on this platform. Comparing our algorithm with one that learns both actions simultaneously, we observe superior results in shorter timesteps. Furthermore, experiments conducted under various parking conditions demonstrate the algorithm’s strong generalization capabilities.
What problem does this paper attempt to address?