Abstract:LiDAR-based sparse 3-D object detection plays a crucial role in autonomous driving applications due to its computational efficiency advantages. Existing methods either use the features of a single central voxel as an object proxy or treat an aggregated cluster of foreground points as an object proxy. However, the former cannot aggregate contextual information, resulting in insufficient information expression in object proxies. The latter relies on multistage pipelines and auxiliary tasks, which reduce the inference speed. To maintain the efficiency of the sparse framework while fully aggregating contextual information, in this work, we propose SparseDet that designs sparse queries as object proxies. It introduces two key modules: the local multiscale feature aggregation (LMFA) module and the global feature aggregation (GFA) module, aiming to fully capture the contextual information, thereby enhancing the ability of the proxies to represent objects. The LMFA module achieves feature fusion across different scales for sparse key voxels via coordinate transformations and using nearest neighbor relationships to capture object-level details and local contextual information, whereas the GFA module uses self-attention mechanisms to selectively aggregate the features of the key voxels across the entire scene for capturing scene-level contextual information. Experiments on nuScenes and KITTI demonstrate the effectiveness of our method. Specifically, SparseDet surpasses the previous best sparse detector VoxelNeXt (a typical method using voxels as object proxies) by 2.2% mean average precision (mAP) with 13.5 frames/s on nuScenes and outperforms VoxelNeXt by 1.12% on hard level tasks with 17.9 frames/s on KITTI. What is more, not only the mAP of SparseDet exceeds that of FSDV2 (a classical method using clusters of foreground points as object proxies) but also its inference speed is 1.3 times faster than FSDV2 on the nuScenes test set. The code has been released in https://github.com/liulin813/SparseDet.git.

EFNet: enhancing feature information for 3D object detection in LiDAR point clouds

Fusing LiDAR and Radar with Pillars Attention for 3D Object Detection

EFMF-pillars: 3D object detection based on enhanced features and multi-scale fusion

PillarNet++: Pillar-Based 3-D Object Detection with Multiattention

A LiDAR Multi-Object Detection Algorithm for Autonomous Driving

PEPillar: a point-enhanced pillar network for efficient 3D object detection in autonomous driving

EPNet++: Cascade Bi-Directional Fusion for Multi-Modal 3D Object Detection

SDFNet:A Sparse Dilation Fusion Network for Multi-scale LiDAR 3D Object Detection

DynStatF: An Efficient Feature Fusion Strategy for LiDAR 3D Object Detection

PillarNeXt: Rethinking Network Designs for 3D Object Detection in LiDAR Point Clouds

SP-Net: A Sparse Convolution and Point-Encoding Enhanced Network for 3D Object Detection in LiDAR Point Clouds.

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-based 3D Object Detection

Improved Pillar with Fine-grained Feature for 3D Object Detection

PillarNeXt: Improving the 3D detector by introducing Voxel2Pillar feature encoding and extracting multi-scale features

An Efficient Point Cloud-based 3D Single Stage Object Detector*

Fine-Grained Pillar Feature Encoding Via Spatio-Temporal Virtual Grid for 3D Object Detection

SIENet: Spatial Information Enhancement Network for 3D Object Detection from Point Cloud

SwiftPillars: High-Efficiency Pillar Encoder for Lidar-Based 3D Detection

Spatial Information Enhancement with Multi-Scale Feature Aggregation for Long-Range Object and Small Reflective Area Object Detection from Point Cloud

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-Based 3-D Object Detection

DVFENet: Dual-branch voxel feature extraction network for 3D object detection