Abstract:Category-specific 3D object shape models have greatly boosted the recent advances in object detection, recognition and segmentation. However, even the most advanced approach for learning 3D object shapes still requires heavy manual annotations on large-scale 2D images. Such annotations include object categories, object keypoints, and figure-ground segmentation for the instances in each image. In particular, annotating figure-ground segmentation is unbearably labor-intensive and time-consuming. To address this problem, this paper devotes to learn category-specific 3D shape models under weak supervision, where only object categories and keypoints are required to be manually annotated on the training 2D images. By exploring the underlying relationship between two tasks: object segmentation and category-specific 3D shape reconstruction, we propose a novel weakly-supervised learning framework to jointly address these two tasks and combine them to boost the final performance of the learned 3D shape models. Moreover, learning without using figure-ground segmentation leads to ambiguous solutions. To this end, we develop the confidence weighting schemes in the viewpoint estimation and 3D shape learning procedure. These schemes effectively reduce the confusion caused by the noisy data and thus increase the chances for recovering more reliable 3D object shapes. Comprehensive experiments on the challenging PASCAL VOC benchmark show that our framework achieves comparable performance with the state-of-the-art methods that use expensive manual segmentation-level annotations. In addition, our experiments also demonstrate that our 3D shape models improve object segmentation performance.

Semi-supervised 3D shape segmentation with multilevel consistency and part substitution

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

Semi-Supervised 3D Medical Image Segmentation Using Shape-Guided Dual Consistency Learning

Semi-Supervised 3D Shape Segmentation via Self Refining

Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

3D Shape Segmentation Using Soft Density Peak Clustering and Semi-Supervised Learning

Learning Fine-Grained Segmentation of 3D Shapes without Part Labels

Unsupervised Part Segmentation through Disentangling Appearance and Shape

Shape-Guided Dual Consistency Semi-Supervised Learning Framework for 3-D Medical Image Segmentation

Weakly Supervised 3D Instance Segmentation without Instance-level Annotations

Semi-Supervised 3D Medical Image Segmentation Based on Dual-Task Consistent Joint Learning and Task-Level Regularization.

Unsupervised 3D Shape Segmentation and Co-Segmentation Via Deep Learning.

Semi-Supervised Single-View 3D Reconstruction Via Prototype Shape Priors

Shape-aware Multi-task Learning for Semi-supervised 3D Medical Image Segmentation.

Semantic Segmentation-Assisted Instance Feature Fusion for Multi-Level 3D Part Instance Segmentation

Weakly-Supervised Learning of Category-Specific 3D Object Shapes.

3D Meta-Segmentation Neural Network

Unsupervised 3D Learning for Shape Analysis Via Multiresolution Instance Discrimination

Shape and boundary-aware multi-branch model for semi-supervised medical image segmentation