Abstract:Category-specific 3D object shape models have greatly boosted the recent advances in object detection, recognition and segmentation. However, even the most advanced approach for learning 3D object shapes still requires heavy manual annotations on large-scale 2D images. Such annotations include object categories, object keypoints, and figure-ground segmentation for the instances in each image. In particular, annotating figure-ground segmentation is unbearably labor-intensive and time-consuming. To address this problem, this paper devotes to learn category-specific 3D shape models under weak supervision, where only object categories and keypoints are required to be manually annotated on the training 2D images. By exploring the underlying relationship between two tasks: object segmentation and category-specific 3D shape reconstruction, we propose a novel weakly-supervised learning framework to jointly address these two tasks and combine them to boost the final performance of the learned 3D shape models. Moreover, learning without using figure-ground segmentation leads to ambiguous solutions. To this end, we develop the confidence weighting schemes in the viewpoint estimation and 3D shape learning procedure. These schemes effectively reduce the confusion caused by the noisy data and thus increase the chances for recovering more reliable 3D object shapes. Comprehensive experiments on the challenging PASCAL VOC benchmark show that our framework achieves comparable performance with the state-of-the-art methods that use expensive manual segmentation-level annotations. In addition, our experiments also demonstrate that our 3D shape models improve object segmentation performance.

3D Shape Segmentation Using Soft Density Peak Clustering and Semi-Supervised Learning

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Semi-Supervised 3D Shape Segmentation via Self Refining

Semi-supervised 3D shape segmentation with multilevel consistency and part substitution

Unsupervised 3D Shape Segmentation and Co-Segmentation Via Deep Learning.

A Semi-Supervised Color Image Segmentation Method

Weakly Supervised 3D Instance Segmentation without Instance-level Annotations

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Unsupervised Co-Segmentation of 3D Shapes Via Affinity Aggregation Spectral Clustering.

Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images

3D Shape Segmentation Via Attentive Nonuniform Downsampling

Online 3D Shape Segmentation by Blended Learning.

Semi-Supervised Mesh Segmentation and Labeling

Weakly-Supervised Learning of Category-Specific 3D Object Shapes.

Unsupervised Part Segmentation through Disentangling Appearance and Shape

Learnable Pixel Clustering Via Structure and Semantic Dual Constraints for Unsupervised Image Segmentation.

iSeg3D: An Interactive 3D Shape Segmentation Tool

Unsupervised 3D Learning for Shape Analysis Via Multiresolution Instance Discrimination

Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination

Clustering based Point Cloud Representation Learning for 3D Analysis