Abstract:In this paper, we propose a weakly-supervised approach for 3D object detection, which makes it possible to train a strong 3D detector with position-level annotations (i.e. annotations of object centers and categories). In order to remedy the information loss from box annotations to centers, our method makes use of synthetic 3D shapes to convert the position-level annotations into virtual scenes with box-level annotations, and in turn utilizes the fully-annotated virtual scenes to complement the real labels. Specifically, we first present a shape-guided label-enhancement method, which assembles 3D shapes into physically reasonable virtual scenes according to the coarse scene layout extracted from position-level annotations. Then we transfer the information contained in the virtual scenes back to real ones by applying a virtual-to-real domain adaptation method, which refines the annotated object centers and additionally supervises the training of detector with the virtual scenes. Since the shape-guided label enhancement method generates virtual scenes by human-heuristic physical constraints, the layout of the fixed virtual scenes may be unreasonable with varied object combinations. To address this, we further present differentiable label enhancement to optimize the virtual scenes including object scales, orientations and locations in a data-driven manner. Moreover, we further propose a label-assisted self-training strategy to fully exploit the capability of detector. By reusing the position-level annotations and virtual scenes, we fuse the information from both domains and generate box-level pseudo labels on the real scenes, which enables us to directly train a detector in fully-supervised manner. Extensive experiments on the widely used ScanNet and Matterport3D datasets show that our approach surpasses current weakly-supervised and semi-supervised methods by a large margin, and achieves comparable detection performance with some popular fully-supervised methods with less than 5% of the labeling labor.

ATF-3D: Semi-Supervised 3D Object Detection With Adaptive Thresholds Filtering Based on Confidence and Distance

MT-SSD: Single-Stage 3D Object Detector Based on Magnification Transformation

Semi-Supervised 3d Object Detection Via Adaptive Pseudo-Labeling

Back to Reality: Learning Data-Efficient 3D Object Detector with Shape Guidance.

SPV-SSD: An Anchor-Free 3D Single-Stage Detector with Supervised-PointRendering and Visibility Representation

PE-MCAT: Leveraging Image Sensor Fusion and Adaptive Thresholds for Semi-Supervised 3D Object Detection

SS3D: Sparsely-Supervised 3D Object Detection from Point Cloud

Point-DETR3D: Leveraging Imagery Data with Spatial Point Prior for Weakly Semi-supervised 3D Object Detection

DQS3D: Densely-matched Quantization-aware Semi-supervised 3D Detection

SSDA3D: Semi-supervised Domain Adaptation for 3D Object Detection from Point Cloud

Improving Point Cloud Semantic Segmentation by Learning 3D Object Detection

Approaching Outside: Scaling Unsupervised 3D Object Detection from 2D Scene

Are Dense Labels Always Necessary for 3D Object Detection from Point Cloud?

Towards A Weakly Supervised Framework for 3D Point Cloud Object Detection and Annotation

SC3D: Label-Efficient Outdoor 3D Object Detection via Single Click Annotation

3DIoUMatch: Leveraging IoU Prediction for Semi-Supervised 3D Object Detection

ODM3D: Alleviating Foreground Sparsity for Semi-Supervised Monocular 3D Object Detection

SSC3OD: Sparsely Supervised Collaborative 3D Object Detection from LiDAR Point Clouds

SESS: Self-Ensembling Semi-Supervised 3D Object Detection

Semi-supervised 3D Object Detection with PatchTeacher and PillarMix

A weakly supervised method for 3D object detection with partially annotated samples