Abstract:Under harsh conditions, such as rain, snow, dust, strong light, and dark night, the vision and laser sensors commonly used in autonomous driving solutions may fail because they can not accurately sense the external environment. Therefore, a method for vehicle localization using underground target features sensed by deep learning assisted ground penetrating radar is proposed in this paper. The proposed method is divided into two phases: offline mapping phase and online localization phase. In the offline mapping phase, the ground penetrating radar is used to collect the echo data from the underground targets first, then the Deep Convolutional Neural Network (DCNN) is utilized to extract the target features from the collected echo data, and the extracted target features are saved with the current geographic location information to form a fingerprint map of underground target features. In the localization phase, the DCNN is used to extract the target features from the current echo data collected by the ground penetrating radar first, and then the target feature most similar to the current extracted target feature in the fingerprint map of underground target features is retrieved based on the particle swarm optimization method, and the geographic location information of the retrieved feature is marked as the vehicle localization result by the ground penetrating radar. Finally, the Kalman filter is used to fuse the ground penetrating radar localization result and the mileage information measured by the ranging wheel to obtain a high-precision localization result. The localization performance of the proposed localization method is tested on the experimental scenario with rich underground targets and the actual urban road scenario. The experimental results show that, compared with the single raw data-based ground penetrating radar localization method, the deep learning assisted ground penetrating radar localization method can avoid directly calculating the similarity between the raw radar data, reduce the amount of data computation and data transmission, and has the real-time localization capability. At the same time, the fingerprint map of underground target features is robust to the changes of the raw radar data, so the average localization error of the proposed method is reduced by about 70%. The deep learning assisted ground penetrating radar localization method can be used as a supplement to the detection and localization method of autonomous vehicles in harsh environments in the future.

Multi-Target Rapid Detection of Road Underground Based on NCG-RetinaNet

Lightweight Deep Learning Model for Identifying Tunnel Lining Defects Based on GPR Data

Intelligent Detection of Urban Road Underground Targets by Using Ground Penetrating Radar based on Deep Learning

Automatic identification of GPR targets on roads based on CNN and Grad-CAM

Efficient Underground Target Detection of Urban Roads in Ground-Penetrating Radar Images Based on Neural Networks

AEGLR-Net: Attention Enhanced Global-Local Refined Network for Accurate Detection of Car Body Surface Defects

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

Defects identification and location of underground space for ground penetrating radar based on deep learning

GPR-based Subsurface Object Detection and Reconstruction Using Random Motion and DepthNet

GPR detection localization of underground structures based on deep learning and reverse time migration

Intelligent recognition of ground penetrating radar images in urban road detection: a deep learning approach

Roadbed Defect Detection from Ground Penetrating Radar B-scan Data Using Faster RCNN

Structural Defect Detection for Urban Road Pavement Using 3D Ground Penetrating Radar Based on Deep Learning

Centralized feature pyramid‐based supervised deep learning for object detection model from GPR data

Automatic Defect Detection in Operational High-Speed Railway Tunnels Guided by Train-Mounted Ground Penetrating Radar Data

Road sub-surface defect detection based on gprMax forward simulation-sample generation and Swin Transformer-YOLOX

Research on 3D ground penetrating radar deep underground cavity identification algorithm in urban roads using multi-dimensional time-frequency features

A Deep Learning Assisted Ground Penetrating Radar Localization Method

GCNet: Ground Collapse Prediction Based on the Ground-Penetrating Radar and Deep Learning Technique

Epurate-Net: Efficient Progressive Uncertainty Refinement Analysis for Traffic Environment Urban Road Detection

Deep Learning-Enhanced Numerical Simulation of Ground Penetrating Radar and Image Detection of Road Cracks