Abstract:Although unsupervised feature learning has demonstrated its advantages to reducing the workload of data labeling and network design in many fields, existing unsupervised 3D learning methods still cannot offer a generic network for various shape analysis tasks with competitive performance to supervised methods. In this paper, we propose an unsupervised method for learning a generic and efficient shape encoding network for different shape analysis tasks. The key idea of our method is to jointly encode and learn shape and point features from unlabeled 3D point clouds. For this purpose, we adapt HR-Net to octree-based convolutional neural networks for jointly encoding shape and point features with fused multiresolution subnetworks and design a simple-yet-efficient Multiresolution Instance Discrimination (MID) loss for jointly learning the shape and point features. Our network takes a 3D point cloud as input and output both shape and point features. After training, the network is concatenated with simple task-specific back-end layers and fine-tuned for different shape analysis tasks. We evaluate the efficacy and generality of our method and validate our network and loss design with a set of shape analysis tasks, including shape classification, semantic shape segmentation, as well as shape registration tasks. With simple back-ends, our network demonstrates the best performance among all unsupervised methods and achieves competitive performance to supervised methods, especially in tasks with a small labeled dataset. For fine-grained shape segmentation, our method even surpasses existing supervised methods by a large margin.

Unsupervised Co-Segmentation of 3D Shapes Via Affinity Aggregation Spectral Clustering.

Multi-View Clustering Via Simultaneously Learning Shared Subspace And Affinity Matrix

3D Shapes Co-segmentation by Combining Fuzzy C-Means with Random Walks

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

Recurring Part Arrangements in Shape Collections

3D Shape Co-segmentation by Combining Sparse Representation with Extreme Learning Machine.

Unsupervised Shape Co-segmentation Based on Transformation Network

Unsupervised 3D Shape Segmentation and Co-Segmentation Via Deep Learning.

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

3D Shape Segmentation Using Soft Density Peak Clustering and Semi-Supervised Learning

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Semi-supervised 3D shape segmentation with multilevel consistency and part substitution

Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination

Unsupervised 3D Learning for Shape Analysis Via Multiresolution Instance Discrimination

Unsupervised Part Segmentation through Disentangling Appearance and Shape

User-controllable Mesh Segmentation Using Shape Harmonic Signature

Learning Hybrid Semantic Affinity for Point Cloud Segmentation

Learning Inter-Superpoint Affinity for Weakly Supervised 3D Instance Segmentation

Shared Latent Membership Enables Joint Shape Abstraction and Segmentation With Deformable Superquadrics

Shape Segmentation by Hierarchical Splat Clustering.

Unsupervised Multi-Class Co-Segmentation via Joint-Cut Over $L_{1}$ -Manifold Hyper-Graph of Discriminative Image Regions