A Deep Learning Assisted Ground Penetrating Radar Localization Method
Ni Zhikang,Ye Shengbo,Shi Cheng,Pan Jun,Zheng Zhijie,Fang Guangyou
DOI: https://doi.org/10.11999/JEIT211072
2022-01-01
Abstract:Under harsh conditions, such as rain, snow, dust, strong light, and dark night, the vision and laser sensors commonly used in autonomous driving solutions may fail because they can not accurately sense the external environment. Therefore, a method for vehicle localization using underground target features sensed by deep learning assisted ground penetrating radar is proposed in this paper. The proposed method is divided into two phases: offline mapping phase and online localization phase. In the offline mapping phase, the ground penetrating radar is used to collect the echo data from the underground targets first, then the Deep Convolutional Neural Network (DCNN) is utilized to extract the target features from the collected echo data, and the extracted target features are saved with the current geographic location information to form a fingerprint map of underground target features. In the localization phase, the DCNN is used to extract the target features from the current echo data collected by the ground penetrating radar first, and then the target feature most similar to the current extracted target feature in the fingerprint map of underground target features is retrieved based on the particle swarm optimization method, and the geographic location information of the retrieved feature is marked as the vehicle localization result by the ground penetrating radar. Finally, the Kalman filter is used to fuse the ground penetrating radar localization result and the mileage information measured by the ranging wheel to obtain a high-precision localization result. The localization performance of the proposed localization method is tested on the experimental scenario with rich underground targets and the actual urban road scenario. The experimental results show that, compared with the single raw data-based ground penetrating radar localization method, the deep learning assisted ground penetrating radar localization method can avoid directly calculating the similarity between the raw radar data, reduce the amount of data computation and data transmission, and has the real-time localization capability. At the same time, the fingerprint map of underground target features is robust to the changes of the raw radar data, so the average localization error of the proposed method is reduced by about 70%. The deep learning assisted ground penetrating radar localization method can be used as a supplement to the detection and localization method of autonomous vehicles in harsh environments in the future.