Abstract:Three-dimensional object detection is a pivotal research topic in computer vision, aiming to identify and locate objects in three-dimensional space. It has wide applications in various fields such as geoscience, autonomous driving, and drone navigation. The rapid development of deep learning techniques has led to significant advancements in 3D object detection. However, with the increasing complexity of applications, 3D object detection faces a series of challenges such as data imbalance and the effectiveness of network models. Specifically, in an experiment, our investigation revealed a notable discrepancy in the LiDAR reflection intensity within a point cloud scene, with stronger intensities observed in proximity and weaker intensities observed at a distance. Furthermore, we have also noted a substantial disparity in the number of foreground points compared to the number of background points. Especially in 3D object detection, the foreground point is more important than the background point, but it is usually downsampled without discrimination in the subsequent processing. With the objective of tackling these challenges, we work from both data and network perspectives, designing a feature alignment filtering algorithm and a two-stage 3D object detection network. Firstly, in order to achieve feature alignment, we introduce a correction equation to decouple the relationship between distance and intensity and eliminate the attenuation effect of intensity caused by distance. Then, a background point filtering algorithm is designed by using the aligned data to alleviate the problem of data imbalance. At the same time, we take into consideration the fact that the accuracy of semantic segmentation plays a crucial role in 3D object detection. Therefore, we propose a two-stage deep learning network that integrates spatial and spectral information, in which a feature fusion branch is designed and embedded in the semantic segmentation backbone. Through a series of experiments on the KITTI dataset, it is proven that the proposed method achieves the following average precision (AP_R40) values for easy, moderate, and hard difficulties, respectively: car (Iou 0.7)—89.23%, 80.14%, and 77.89%; pedestrian (Iou 0.5)—52.32%, 45.47%, and 38.78%; and cyclist (Iou 0.5)—76.41%, 61.92%, and 56.39%. By emphasizing both data quality optimization and efficient network architecture, the performance of the proposed method is made comparable to other state-of-the-art methods.

3D Object Detection on Large-Scale Dataset

LiDAR-CS Dataset: LiDAR Point Cloud Dataset with Cross-Sensors for 3D Object Detection

Every Dataset Counts: Scaling up Monocular 3D Object Detection with Joint Datasets Training

Generalized Few-Shot 3D Object Detection of LiDAR Point Cloud for Autonomous Driving

Real-Time And Robust 3D Object Detection with Roadside LiDARs

3D Point Cloud Stitching for Object Detection with Wide FoV Using Roadside LiDAR

Spatial Information Enhancement with Multi-Scale Feature Aggregation for Long-Range Object and Small Reflective Area Object Detection from Point Cloud

Three-Dimensional Point Cloud Object Detection Based on Feature Fusion and Enhancement

Enhancing 3D object detection through multi-modal fusion for cooperative perception

Robustness-Aware 3D Object Detection in Autonomous Driving: A Review and Outlook

Future Does Matter: Boosting 3D Object Detection with Temporal Motion Estimation in Point Cloud Sequences

Large receptive field strategy and important feature extraction strategy in 3D object detection

Investigating the Impact of Multi-LiDAR Placement on Object Detection for Autonomous Driving

Vision-Language Guidance for LiDAR-based Unsupervised 3D Object Detection

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

6DoF-3D: Efficient and accurate 3D object detection using six degrees-of-freedom for autonomous driving

Equal Emphasis on Data and Network: A Two-Stage 3D Point Cloud Object Detection Algorithm with Feature Alignment

From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detection

1st Place Solution for Waymo Open Dataset Challenge -- 3D Detection and Domain Adaptation

LiDAR-based 4D Panoptic Segmentation via Dynamic Shifting Network

Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detection