Abstract:Three-dimensional object detection is a pivotal research topic in computer vision, aiming to identify and locate objects in three-dimensional space. It has wide applications in various fields such as geoscience, autonomous driving, and drone navigation. The rapid development of deep learning techniques has led to significant advancements in 3D object detection. However, with the increasing complexity of applications, 3D object detection faces a series of challenges such as data imbalance and the effectiveness of network models. Specifically, in an experiment, our investigation revealed a notable discrepancy in the LiDAR reflection intensity within a point cloud scene, with stronger intensities observed in proximity and weaker intensities observed at a distance. Furthermore, we have also noted a substantial disparity in the number of foreground points compared to the number of background points. Especially in 3D object detection, the foreground point is more important than the background point, but it is usually downsampled without discrimination in the subsequent processing. With the objective of tackling these challenges, we work from both data and network perspectives, designing a feature alignment filtering algorithm and a two-stage 3D object detection network. Firstly, in order to achieve feature alignment, we introduce a correction equation to decouple the relationship between distance and intensity and eliminate the attenuation effect of intensity caused by distance. Then, a background point filtering algorithm is designed by using the aligned data to alleviate the problem of data imbalance. At the same time, we take into consideration the fact that the accuracy of semantic segmentation plays a crucial role in 3D object detection. Therefore, we propose a two-stage deep learning network that integrates spatial and spectral information, in which a feature fusion branch is designed and embedded in the semantic segmentation backbone. Through a series of experiments on the KITTI dataset, it is proven that the proposed method achieves the following average precision (AP_R40) values for easy, moderate, and hard difficulties, respectively: car (Iou 0.7)—89.23%, 80.14%, and 77.89%; pedestrian (Iou 0.5)—52.32%, 45.47%, and 38.78%; and cyclist (Iou 0.5)—76.41%, 61.92%, and 56.39%. By emphasizing both data quality optimization and efficient network architecture, the performance of the proposed method is made comparable to other state-of-the-art methods.

Neural network-based 3D point cloud detection of targets in unstructured environments

3-D Vehicle Detection Enhancement Using Tracking Feedback in Sparse Point Clouds Environments

3D Object Detection Based on Extremely Sparse Laser Point Cloud and RGB Images

Efficient and accurate object detection for 3D point clouds in intelligent visual internet of things

Research on 3D Point Cloud Object Detection Algorithm for Autonomous Driving

Equal Emphasis on Data and Network: A Two-Stage 3D Point Cloud Object Detection Algorithm with Feature Alignment

Overview of LiDAR point cloud target detection methods based on deep learning

Combined Edge- and Stixel-based Object Detection in 3D Point Cloud

Three-Dimensional Point Cloud Object Detection Based on Feature Fusion and Enhancement

Learning Deformable Network for 3D Object Detection on Point Clouds

Realtime Single-Shot Refinement Neural Network With Adaptive Receptive Field for 3D Object Detection From LiDAR Point Cloud

An Automatic Road Surface Segmentation in Non-Urban Environments: A 3D Point Cloud Approach With Grid Structure and Shallow Neural Networks

Environmental Detection for Autonomous Vehicles Based on Multi-View Image and 3D LiDAR Point Cloud Map

On-road multiple obstacles detection using color images and LiDAR point clouds

Deep learning for 3D Object Detection and Tracking in Autonomous Driving: A Brief Survey

Real-Time 3D Object Detection on Crowded Pedestrians

CFPC: The Curbed Fake Point Collector to Pseudo-LiDAR-Based 3D Object Detection for Autonomous Vehicles

Monocular 3D Detection for Autonomous Vehicles by Cascaded Geometric Constraints and Depurated Using 3D Results

3D Point Cloud Denoising via Deep Neural Network Based Local Surface Estimation

Sparse Points to Dense Clouds: Enhancing 3D Detection with Limited LiDAR Data

MSPV3D: Multi-Scale Point-Voxels 3D Object Detection Net