Abstract:With the continuous emergence and development of 3D sensors in recent years, it has become increasingly convenient to collect point cloud data for 3D object detection tasks, such as the field of autonomous driving. But when using these existing methods, there are two problems that cannot be ignored: (1) The bird's eye view (BEV) is a widely used method in 3D objective detection; however, the BEV usually compresses dimensions by combined height, dimension, and channels, which makes the process of feature extraction in feature fusion more difficult. (2) Light detection and ranging (LiDAR) has a much larger effective scanning depth, which causes the sector to become sparse in deep space and the uneven distribution of point cloud data. This results in few features in the distribution of neighboring points around the key points of interest. The following is the solution proposed in this paper: (1) This paper proposes multi-scale feature fusion composed of feature maps at different levels made of Deep Layer Aggregation (DLA) and a feature fusion module for the BEV. (2) A point completion network is used to improve the prediction results by completing the feature points inside the candidate boxes in the second stage, thereby strengthening their position features. Supervised contrastive learning is applied to enhance the segmentation results, improving the discrimination capability between the foreground and background. Experiments show these new additions can achieve improvements of 2.7%, 2.4%, and 2.5%, respectively, on KITTI easy, moderate, and hard tasks. Further ablation experiments show that each addition has promising improvement over the baseline.

A Single-Stage 3D Object Detection Method Based on Sparse Attention Mechanism.

SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos

IMAM: Incorporating Multiple Attention Mechanisms for 3D Object Detection from Point Cloud

Three-Attention Mechanisms for One-Stage 3-D Object Detection Based on LiDAR and Camera

STD: Sparse-to-Dense 3D Object Detector for Point Cloud

Accurate and Real-Time Object Detection Based on Bird's Eye View on 3D Point Clouds

Three-Dimensional Point Cloud Object Detection Based on Feature Fusion and Enhancement

An Efficient Point Cloud-based 3D Single Stage Object Detector*

BEVDepth: Acquisition of Reliable Depth for Multi-View 3D Object Detection

Multi-feature Enhancement Based on Sparse Networks for Single-Stage 3D Object Detection

Research on 3D Object Detection Method Based on Convolutional Attention Mechanism

A Streamlined Framework for Bev-Based 3d Object Detection with Prior Masking

S-AT GCN: Spatial-Attention Graph Convolution Network based Feature Enhancement for 3D Object Detection

VFL3D: A Single-Stage Fine-Grained Lightweight Point Cloud 3D Object Detection Algorithm Based on Voxels

VoxelFormer: Bird's-Eye-View Feature Generation based on Dual-view Attention for Multi-view 3D Object Detection

MaskBEV: Joint Object Detection and Footprint Completion for Bird's-eye View 3D Point Clouds

Structure Aware Single-Stage 3D Object Detection From Point Cloud

Enhance the 3D Object Detection With 2D Prior

Learning High-resolution Vector Representation from Multi-Camera Images for 3D Object Detection

BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-View