Abstract:Monocular 3D object detection is a challenging task in the self-driving and computer vision community. As a common practice, most previous works use manually annotated 3D box labels, where the annotating process is expensive. In this paper, we find that the precisely and carefully annotated labels may be unnecessary in monocular 3D detection, which is an interesting and counterintuitive finding. Using rough labels that are randomly disturbed, the detector can achieve very close accuracy compared to the one using the ground-truth labels. We delve into this underlying mechanism and then empirically find that: concerning the label accuracy, the 3D location part in the label is preferred compared to other parts of labels. Motivated by the conclusions above and considering the precise LiDAR 3D measurement, we propose a simple and effective framework, dubbed LiDAR point cloud guided monocular 3D object detection (LPCG). This framework is capable of either reducing the annotation costs or considerably boosting the detection accuracy without introducing extra annotation costs. Specifically, It generates pseudo labels from unlabeled LiDAR point clouds. Thanks to accurate LiDAR 3D measurements in 3D space, such pseudo labels can replace manually annotated labels in the training of monocular 3D detectors, since their 3D location information is precise. LPCG can be applied into any monocular 3D detector to fully use massive unlabeled data in a selfdriving system. As a result, in KITTI benchmark, we take the first place on both monocular 3D and BEV (bird's-eye-view) detection with a significant margin. In Waymo benchmark, our method using 10% labeled data achieves comparable accuracy to the baseline detector using 100% labeled data. The codes are released at https://github.com/SPengLiang/LPCG.

Once Detected, Never Lost: Surpassing Human Performance in Offline LiDAR based 3D Object Detection

MT-SSD: Single-Stage 3D Object Detector Based on Magnification Transformation

Offline Tracking with Object Permanence

Real-Time And Robust 3D Object Detection with Roadside LiDARs

DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Clouds

Commonsense Prototype for Outdoor Unsupervised 3D Object Detection

Lidar Point Cloud Guided Monocular 3D Object Detection

Super Sparse 3D Object Detection

Towards Unsupervised Object Detection From LiDAR Point Clouds

Embracing Single Stride 3D Object Detector with Sparse Transformer

Cross-Modal 3D Object Detection and Tracking for Auto-Driving

Vision-Language Guidance for LiDAR-based Unsupervised 3D Object Detection

Realtime Single-Shot Refinement Neural Network With Adaptive Receptive Field for 3D Object Detection From LiDAR Point Cloud

Generalized Few-Shot 3D Object Detection of LiDAR Point Cloud for Autonomous Driving

Real-Time 3D Object Detection From Point Cloud Through Foreground Segmentation

Real-Time 3D Object Detection on Crowded Pedestrians

Ret3D: Rethinking Object Relations for Efficient 3D Object Detection in Driving Scenes

Sample, Crop, Track: Self-Supervised Mobile 3D Object Detection for Urban Driving LiDAR

An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

DALDet: Depth-Aware Learning Based Object Detection for Autonomous Driving

Sparse4D v3: Advancing End-to-End 3D Detection and Tracking