Abstract:The real-time and accurate detection of three-dimensional (3D) objects based on LiDAR is a focal problem in the field of autonomous driving environment perception. Compared to two-stage and anchor-based 3D object detection methods that suffer from inference latency challenges, single-stage anchor-free 3D object detection approaches are more suitable for deployment in autonomous driving vehicles with the strict real-time requirement. However, they face the issue of insufficient spatial awareness, which can result in detection errors such as false positives and false negatives, thereby increasing the potential risks of autonomous driving. In response to this, we focus on enhancing the spatial awareness of CenterPoint, a widely used single-stage anchor-free 3D object detector in the industry. Considering the limited allocation of computational resources and the performance bottleneck caused by pillar encoder, we propose an efficient SSDCM backbone to strengthen feature representation and extraction. Furthermore, a simple BGC neck is devised to weight and exchange contextual information in order to deeply fuse multi-scale features. Combining improved backbone and neck networks, we construct a single-stage anchor-free 3D object detection model with spatial awareness enhancement, named CenterPoint-Spatial Awareness Enhancement (CenterPoint-SAE). We evaluate CenterPoint-SAE on two large-scale and challenging autonomous driving datasets, nuScenes and Waymo. It achieves 53.3% mAP and 62.5% NDS on nuScenes detection benchmark, and runs inference at a speed of 11.1 FPS. Compared to the baseline, the upgraded networks deliver a performance improvement of 1.6% mAP and 1.2% NDS at minor cost. Notably, on Waymo dataset, our method achieves competitive detection performance compared to two-stage and point-based methods.

Lightweight Map-Enhanced 3D Object Detection and Tracking for Autonomous Driving.

A Tracking-By-Detection Based 3D Multiple Object Tracking for Autonomous Driving

Cross-Modal 3D Object Detection and Tracking for Auto-Driving

Dynamic Object Tracking for Self-Driving Cars Using Monocular Camera and LIDAR.

Semantically Enhanced Multi-Object Detection and Tracking for Autonomous Vehicles.

Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Driving

3D Object Detection for Point Cloud in Virtual Driving Environment

Real-Time And Robust 3D Object Detection with Roadside LiDARs

Spatial Awareness Enhancement Based Single-Stage Anchor-Free 3D Object Detection for Autonomous Driving

An Efficient Real-Time Object Detection and Tracking Framework Based on Lidar and Ins

An IMM-Enabled Adaptive 3D Multi-Object Tracker for Autonomous Driving

Driving Behavior-Aware Network for 3D Object Tracking in Complex Traffic Scenes

3D Object Detection for Autonomous Driving: A Comprehensive Survey

Enhancing 3D object detection through multi-modal fusion for cooperative perception

Survey on deep learning-based 3D object detection in autonomous driving

Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera

Enhanced Detection Model and Joint Scoring Strategy for Multi-Vehicle Tracking

Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehicles

Monocular Quasi-Dense 3D Object Tracking

MENet: Multi-Modal Mapping Enhancement Network for 3D Object Detection in Autonomous Driving