GLENet: Boosting 3D Object Detectors with Generative Label Uncertainty Estimation

Yifan Zhang,Qijian Zhang,Zhiyu Zhu,Junhui Hou,Yixuan Yuan

2024-07-08

Abstract:The inherent ambiguity in ground-truth annotations of 3D bounding boxes, caused by occlusions, signal missing, or manual annotation errors, can confuse deep 3D object detectors during training, thus deteriorating detection accuracy. However, existing methods overlook such issues to some extent and treat the labels as deterministic. In this paper, we formulate the label uncertainty problem as the diversity of potentially plausible bounding boxes of objects. Then, we propose GLENet, a generative framework adapted from conditional variational autoencoders, to model the one-to-many relationship between a typical 3D object and its potential ground-truth bounding boxes with latent variables. The label uncertainty generated by GLENet is a plug-and-play module and can be conveniently integrated into existing deep 3D detectors to build probabilistic detectors and supervise the learning of the localization uncertainty. Besides, we propose an uncertainty-aware quality estimator architecture in probabilistic detectors to guide the training of the IoU-branch with predicted localization uncertainty. We incorporate the proposed methods into various popular base 3D detectors and demonstrate significant and consistent performance gains on both KITTI and Waymo benchmark datasets. Especially, the proposed GLENet-VR outperforms all published LiDAR-based approaches by a large margin and achieves the top rank among single-modal methods on the challenging KITTI test set. The source code and pre-trained models are publicly available at \url{<a class="link-external link-https" href="https://github.com/Eaphan/GLENet" rel="external noopener nofollow">this https URL</a>}.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the inherent ambiguity of ground - truth annotations in 3D object detection due to occlusion, signal loss or manual annotation errors, etc. This will interfere with the performance of deep 3D object detectors during the training process, thereby reducing the detection accuracy. Existing methods largely ignore these problems and treat labels as deterministic. For this reason, the authors propose a new framework, GLENet, to estimate label uncertainty through a generative model, thereby improving the performance of 3D object detectors.

Specifically, the main contributions of the paper include:

1. **Model the 3D label uncertainty problem as the diversity of potentially reasonable bounding boxes of objects for the first time**. To capture the one - to - many relationship between a typical 3D object and its potentially reasonable ground - truth bounding boxes, a deep generative model, GLENet, is proposed.

2. **Introduce a general and unified deep - learning - based paradigm**, including network structure, loss function, evaluation metrics, etc., for estimating label uncertainty.

3. **Propose an Uncertainty - Aware Quality Evaluator (UAQE)** to promote the training of the IoU branch by using the predicted localization uncertainty.

Through these methods, GLENet can be easily integrated into existing deep 3D detectors to build probabilistic detectors and supervise the learning of localization uncertainty. Experimental results show that this method brings significant and consistent performance improvements on the KITTI and Waymo benchmark datasets. In particular, the proposed GLENet - VR outperforms all published LiDAR - based methods in single - modality methods and ranks first in the challenging KITTI test set.