Abstract:In autonomous driving, LiDAR (light detection and ranging) data are acquired over time. Most existing 3D object detection algorithms propose the object bounding box by processing each frame of data independently, which ignores the temporal sequence information. However, the temporal sequence information is usually helpful to detect the object with missing shape information due to long distance or occlusion. To address this problem, we propose a temporal sequence information fusion 3D point cloud object detection algorithm based on the Ada-GRU (adaptive gated recurrent unit). In this method, the feature of each frame for the LiDAR point cloud is extracted through the backbone network and is fed to the Ada-GRU together with the hidden features of the previous frames. Compared to the traditional GRU, the Ada-GRU can adjust the gating mechanism adaptively during the training process by introducing the adaptive activation function. The Ada-GRU outputs the temporal sequence fusion features to predict the 3D object in the current frame and transmits the hidden features of the current frame to the next frame. At the same time, the label uncertainty of the distant and occluded objects affects the training effect of the model. For this problem, this paper proposes a probability distribution model of 3D bounding box coordinates based on the Gaussian distribution function and designs the corresponding bounding box loss function to enable the model to learn and estimate the uncertainty of the positioning of the bounding box coordinates, so as to remove the bounding box with large positioning uncertainty in the post-processing stage to reduce the false positive rate. Finally, the experiments show that the methods proposed in this paper improve the accuracy of the object detection without significantly increasing the complexity of the algorithm.

3D Point Cloud Object Detection Algorithm Based on Temporal Information Fusion and Uncertainty Estimation

Research on 3D Point Cloud Object Detection Algorithm for Autonomous Driving

Three-Dimensional Point Cloud Object Detection Based on Feature Fusion and Enhancement

Future Does Matter: Boosting 3D Object Detection with Temporal Motion Estimation in Point Cloud Sequences

A Multi-view 3D Vehicle Detection Method Based On Novel 3D Proposal Generation Method

F-PVNet: Frustum-Level 3-D Object Detection on Point–Voxel Feature Representation for Autonomous Driving

An LSTM Approach to Temporal 3D Object Detection in LiDAR Point Clouds

Harnessing Uncertainty-aware Bounding Boxes for Unsupervised 3D Object Detection

3D object detection algorithm based on multi-sensor segmental fusion of frustum association for autonomous driving

3D Object Detection Based on Extremely Sparse Laser Point Cloud and RGB Images

3D Object Detection Method Based on YOLO and K-Means for Image and Point Clouds

LiDAR-Based 3D Temporal Object Detection via Motion-Aware LiDAR Feature Fusion

Object Detection Based on Fusion of Sparse Point Cloud and Image Information

Exploiting Label Uncertainty for Enhanced 3D Object Detection From Point Clouds

Accelerating Point-Voxel Representation of 3-D Object Detection for Automatic Driving

Generalized Few-Shot 3D Object Detection of LiDAR Point Cloud for Autonomous Driving

Dynamic Multitarget Detection Algorithm of Voxel Point Cloud Fusion Based on PointRCNN

Real time object detection using LiDAR and camera fusion for autonomous driving

3D Dynamic Multi-target Detection Algorithm Based on Cross-view Feature Fusion

Augmenting 3-D Object Detection Through Data Uncertainty-Driven Auxiliary Framework

YOLO and K-Means Based 3D Object Detection Method on Image and Point Cloud