Abstract:LiDAR-based sparse 3-D object detection plays a crucial role in autonomous driving applications due to its computational efficiency advantages. Existing methods either use the features of a single central voxel as an object proxy or treat an aggregated cluster of foreground points as an object proxy. However, the former cannot aggregate contextual information, resulting in insufficient information expression in object proxies. The latter relies on multistage pipelines and auxiliary tasks, which reduce the inference speed. To maintain the efficiency of the sparse framework while fully aggregating contextual information, in this work, we propose SparseDet that designs sparse queries as object proxies. It introduces two key modules: the local multiscale feature aggregation (LMFA) module and the global feature aggregation (GFA) module, aiming to fully capture the contextual information, thereby enhancing the ability of the proxies to represent objects. The LMFA module achieves feature fusion across different scales for sparse key voxels via coordinate transformations and using nearest neighbor relationships to capture object-level details and local contextual information, whereas the GFA module uses self-attention mechanisms to selectively aggregate the features of the key voxels across the entire scene for capturing scene-level contextual information. Experiments on nuScenes and KITTI demonstrate the effectiveness of our method. Specifically, SparseDet surpasses the previous best sparse detector VoxelNeXt (a typical method using voxels as object proxies) by 2.2% mean average precision (mAP) with 13.5 frames/s on nuScenes and outperforms VoxelNeXt by 1.12% on hard level tasks with 17.9 frames/s on KITTI. What is more, not only the mAP of SparseDet exceeds that of FSDV2 (a classical method using clusters of foreground points as object proxies) but also its inference speed is 1.3 times faster than FSDV2 on the nuScenes test set. The code has been released in https://github.com/liulin813/SparseDet.git.

3D Multi-object Detection and Tracking with Sparse Stationary LiDAR

Object tracking with 3D LIDAR via multi-task sparse learning

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

3-D Objects Detection and Tracking Using Solid-State LiDAR and RGB Camera

A Novel LiDAR-Camera Fused Player Tracking System in Soccer Scenarios

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Future Does Matter: Boosting 3D Object Detection with Temporal Motion Estimation in Point Cloud Sequences

Real-Time Three-Dimensional Tracking of Distant Moving Objects Using Non-Imaging Single-Pixel LiDAR

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-based 3D Object Detection

Real-Time Motion Tracking for Indoor Moving Sphere Objects with a LiDAR Sensor

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

Multi-object Detection, Tracking and Prediction in Rugged Dynamic Environments

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

MS23D: A 3D object detection method using multi-scale semantic feature points to construct 3D feature layer

VoxelTrack: Exploring Voxel Representation for 3D Point Cloud Object Tracking

3D Multi-Object Tracking Based on Radar-Camera Fusion

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-Based 3-D Object Detection

Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Driving

Joint Multi-Object Detection and Tracking with Camera-LiDAR Fusion for Autonomous Driving

Sparse4D v3: Advancing End-to-End 3D Detection and Tracking

Motion-to-Matching: A Mixed Paradigm for 3D Single Object Tracking