Abstract:Three-dimensional object detection is a pivotal research topic in computer vision, aiming to identify and locate objects in three-dimensional space. It has wide applications in various fields such as geoscience, autonomous driving, and drone navigation. The rapid development of deep learning techniques has led to significant advancements in 3D object detection. However, with the increasing complexity of applications, 3D object detection faces a series of challenges such as data imbalance and the effectiveness of network models. Specifically, in an experiment, our investigation revealed a notable discrepancy in the LiDAR reflection intensity within a point cloud scene, with stronger intensities observed in proximity and weaker intensities observed at a distance. Furthermore, we have also noted a substantial disparity in the number of foreground points compared to the number of background points. Especially in 3D object detection, the foreground point is more important than the background point, but it is usually downsampled without discrimination in the subsequent processing. With the objective of tackling these challenges, we work from both data and network perspectives, designing a feature alignment filtering algorithm and a two-stage 3D object detection network. Firstly, in order to achieve feature alignment, we introduce a correction equation to decouple the relationship between distance and intensity and eliminate the attenuation effect of intensity caused by distance. Then, a background point filtering algorithm is designed by using the aligned data to alleviate the problem of data imbalance. At the same time, we take into consideration the fact that the accuracy of semantic segmentation plays a crucial role in 3D object detection. Therefore, we propose a two-stage deep learning network that integrates spatial and spectral information, in which a feature fusion branch is designed and embedded in the semantic segmentation backbone. Through a series of experiments on the KITTI dataset, it is proven that the proposed method achieves the following average precision (AP_R40) values for easy, moderate, and hard difficulties, respectively: car (Iou 0.7)—89.23%, 80.14%, and 77.89%; pedestrian (Iou 0.5)—52.32%, 45.47%, and 38.78%; and cyclist (Iou 0.5)—76.41%, 61.92%, and 56.39%. By emphasizing both data quality optimization and efficient network architecture, the performance of the proposed method is made comparable to other state-of-the-art methods.

An Unequal Deep Learning Approach for 3-D Point Cloud Segmentation

End-to-End 3D Point Cloud Instance Segmentation Without Detection

3D Object Segmentation Using Cross-Window Point Transformer with Latent Semantic Boundary Guidance

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Fuzzy Neighborhood Learning for Deep 3-D Segmentation of Point Cloud.

Diffusion unit: Interpretable edge enhancement and suppression learning for 3D point cloud segmentation

Learning to Optimally Segment Point Clouds

Rethinking Design and Evaluation of 3D Point Cloud Segmentation Models

Domain Generalization-Aware Uncertainty Introspective Learning for 3D Point Clouds Segmentation

Deep Learning for 3D Point Clouds: A Survey

Edge Aware Learning for 3D Point Cloud

Contrastive Boundary Learning for Point Cloud Segmentation

Sparse 3D point clouds segmentation considering 2D image feature extraction with deep learning

Learning Generalizable Part-based Feature Representation for 3D Point Clouds

A Survey on Deep Learning Based Segmentation, Detection and Classification for 3D Point Clouds

Research on deep learning algorithms for point cloud upsampling

USING SIMULATION DATA FROM GAMING ENVIRONMENTS FOR TRAINING A DEEP LEARNING ALGORITHM ON 3D POINT CLOUDS

3D Instance Embedding Learning with a Structure-Aware Loss Function for Point Cloud Segmentation.

Equal Emphasis on Data and Network: A Two-Stage 3D Point Cloud Object Detection Algorithm with Feature Alignment

Deep-Learning-Based Point Cloud Semantic Segmentation: A Survey

FEATURE RELEVANCE ANALYSIS FOR 3D POINT CLOUD CLASSIFICATION USING DEEP LEARNING