Abstract:LiDAR-based sparse 3-D object detection plays a crucial role in autonomous driving applications due to its computational efficiency advantages. Existing methods either use the features of a single central voxel as an object proxy or treat an aggregated cluster of foreground points as an object proxy. However, the former cannot aggregate contextual information, resulting in insufficient information expression in object proxies. The latter relies on multistage pipelines and auxiliary tasks, which reduce the inference speed. To maintain the efficiency of the sparse framework while fully aggregating contextual information, in this work, we propose SparseDet that designs sparse queries as object proxies. It introduces two key modules: the local multiscale feature aggregation (LMFA) module and the global feature aggregation (GFA) module, aiming to fully capture the contextual information, thereby enhancing the ability of the proxies to represent objects. The LMFA module achieves feature fusion across different scales for sparse key voxels via coordinate transformations and using nearest neighbor relationships to capture object-level details and local contextual information, whereas the GFA module uses self-attention mechanisms to selectively aggregate the features of the key voxels across the entire scene for capturing scene-level contextual information. Experiments on nuScenes and KITTI demonstrate the effectiveness of our method. Specifically, SparseDet surpasses the previous best sparse detector VoxelNeXt (a typical method using voxels as object proxies) by 2.2% mean average precision (mAP) with 13.5 frames/s on nuScenes and outperforms VoxelNeXt by 1.12% on hard level tasks with 17.9 frames/s on KITTI. What is more, not only the mAP of SparseDet exceeds that of FSDV2 (a classical method using clusters of foreground points as object proxies) but also its inference speed is 1.3 times faster than FSDV2 on the nuScenes test set. The code has been released in https://github.com/liulin813/SparseDet.git.

AirDet: Few-Shot Detection without Fine-tuning for Autonomous Exploration

AirShot: Efficient Few-Shot Detection for Autonomous Exploration

GenDet: Meta Learning to Generate Detectors from Few Shots

Weakly Supervised Few-Shot Object Detection with DETR

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-Based 3-D Object Detection

Robotic Interestingness via Human-Informed Few-Shot Object Detection

UniDet3D: Multi-dataset Indoor 3D Object Detection

PNPDet: Efficient Few-shot Detection Without Forgetting Via Plug-and-Play Sub-networks

Few-shot Object Detection in Remote Sensing: Lifting the Curse of Incompletely Annotated Novel Objects

LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

CABDet: context-and-attention-based detector for small object detection in remote sensing images

Few-Shot Object Detection of Remote Sensing Images via Two-Stage Fine-Tuning

Oriented Object Detection via Contextual Dependence Mining and Penalty-Incentive Allocation

AF-DETR: efficient UAV small object detector via Assemble-and-Fusion mechanism

Detection-Driven Exposure-Correction Network for Nighttime Drone-View Object Detection

AeroDetectNet: A Lightweight, High-Precision Network for Enhanced Detection of Small Objects in Aerial Remote Sensing Imagery.

Innovative Horizons in Aerial Imagery: LSKNet Meets DiffusionDet for Advanced Object Detection

SparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-based 3D Object Detection

Drone-DETR: Efficient Small Object Detection for Remote Sensing Image Using Enhanced RT-DETR Model

Rethinking Drone-Based Search and Rescue with Aerial Person Detection