Abstract:LiDAR-based sparse 3-D object detection plays a crucial role in autonomous driving applications due to its computational efficiency advantages. Existing methods either use the features of a single central voxel as an object proxy or treat an aggregated cluster of foreground points as an object proxy. However, the former cannot aggregate contextual information, resulting in insufficient information expression in object proxies. The latter relies on multistage pipelines and auxiliary tasks, which reduce the inference speed. To maintain the efficiency of the sparse framework while fully aggregating contextual information, in this work, we propose SparseDet that designs sparse queries as object proxies. It introduces two key modules: the local multiscale feature aggregation (LMFA) module and the global feature aggregation (GFA) module, aiming to fully capture the contextual information, thereby enhancing the ability of the proxies to represent objects. The LMFA module achieves feature fusion across different scales for sparse key voxels via coordinate transformations and using nearest neighbor relationships to capture object-level details and local contextual information, whereas the GFA module uses self-attention mechanisms to selectively aggregate the features of the key voxels across the entire scene for capturing scene-level contextual information. Experiments on nuScenes and KITTI demonstrate the effectiveness of our method. Specifically, SparseDet surpasses the previous best sparse detector VoxelNeXt (a typical method using voxels as object proxies) by 2.2% mean average precision (mAP) with 13.5 frames/s on nuScenes and outperforms VoxelNeXt by 1.12% on hard level tasks with 17.9 frames/s on KITTI. What is more, not only the mAP of SparseDet exceeds that of FSDV2 (a classical method using clusters of foreground points as object proxies) but also its inference speed is 1.3 times faster than FSDV2 on the nuScenes test set. The code has been released in https://github.com/liulin813/SparseDet.git.

DALDet: Depth-Aware Learning Based Object Detection for Autonomous Driving

6DoF-3D: Efficient and accurate 3D object detection using six degrees-of-freedom for autonomous driving

Multiclass objects detection algorithm using DarkNet-53 and DenseNet for intelligent vehicles

Keypoint3D: Keypoint-Based and Anchor-Free 3D Object Detection for Autonomous Driving with Monocular Vision

Stereo RGB and Deeper LIDAR-Based Network for 3D Object Detection in Autonomous Driving.

3D Object Detection Based on Extremely Sparse Laser Point Cloud and RGB Images

Ground-aware Monocular 3D Object Detection for Autonomous Driving

Transformation-Equivariant 3D Object Detection for Autonomous Driving

DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries

Real-Time And Robust 3D Object Detection with Roadside LiDARs

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

Cross-Modal 3D Object Detection and Tracking for Auto-Driving

Monocular 3D Object Detection for Distant Objects

Sparse Embedded Convolution Based Dual Feature Aggregation 3D Object Detection Network

Real-Time 3D Object Detection and Classification in Autonomous Driving Environment Using 3D LiDAR and Camera Sensors

3D Detection for Occluded Vehicles From Point Clouds

Multi-feature Enhancement Based on Sparse Networks for Single-Stage 3D Object Detection

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-based 3D Object Detection

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-Based 3-D Object Detection

A Tracking-By-Detection Based 3D Multiple Object Tracking for Autonomous Driving

3D Object Detection for Point Cloud in Virtual Driving Environment