Monocular Pseudo-LiDAR 3D Object Detection Method Based on Confidence and Feature Optimization

Jianlong Zhang,Guangzu Fang,Bin Wang,Chen,Xinyu Guo,Yang Zhou,Ji Li

DOI: https://doi.org/10.1109/smartiot52359.2021.00025

2021-01-01

Abstract:3D object detection based on the monocular Pseudo-LiDAR is cost-effective compared with multi-sensor solutions in autonomous driving, and made great progress in recent. However, these methods still suffer from the following disadvantages, i.e., (1) the depth estimation error of the background points in the Pseudo-LiDAR is larger than that of the object points, which leads to the degradation of the object detection performance. (2) the existing point cloud detection network is difficult to effectively capture the local features and global correlation of Pseudo-LiDAR, which leads to the weak feature representation ability of the point cloud. To this end, we propose a 3D object detection method of Pseudo-LiDAR based on Confidence and Feature optimization. In our method, we first propose a hierarchical structure of the point cloud confidence optimization method, which carries out resampling to filter out the background points according to the confidence distribution, so as to improve the significance of the Pseudo-LiDAR object point cloud. Then, we design a hierarchical feature extraction module, which uses DGCNN to obtain the local features of the keypoints and the point transformer structure to capture the global relevance of the keypoints, so as to improve the feature representation ability of the point cloud. On the popular KITTI benchmark, our approach achieves better performance than the mainstream method.