Abstract:Current supervised methods for 3D shape representation learning have achieved satisfying performance, yet require extensive human-labeled datasets. Unsupervised learning-based methods provide a viable solution by learning shape representations without using ground truth labels. In this study, we develop a contrastive learning framework for unsupervised representation learning of 3D shapes. Specifically, in order to encourage models to pay more attention to useful information during representation learning, we first introduce a new paradigm for critical points search based on the adversarial mechanism. We extract critical points with a larger impact on the global feature by attacking a pre-trained auto-encoder model, and apply data augmentations on these points to generate adversarial examples. Taking a pair of adversarial examples as inputs, we obtain their intermediate embeddings and global representations of corresponding inputs, which are then transformed into latent spaces by two predictor heads. Finally, we train the proposed model by maximizing the agreements on these latent spaces via Normalized Temperature-scaled Cross Entropy (NT-Xent) loss and a newly designed Cross-layer Normalized Temperature-scaled Cross Entropy (Cross-NT-Xent) loss, where the latter is proposed in this paper to enforce cross-layer feature similarities. The effectiveness, robustness, and transferability of learned representations are validated on three downstream tasks, including object classification, few-shot classification, and shape retrieval. Experiments on three benchmark datasets show that our learned representations achieve better or competitive performance than current state-of-the-art methods in these downstream tasks. Moreover, our model can easily be extended to 3D part segmentation and scene segmentation tasks.

Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining

Learning to Measure the Point Cloud Reconstruction Loss in a Representation Space

Is Contrastive Distillation Enough for Learning Comprehensive 3D Representations?

Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-training

P4Contrast: Contrastive Learning with Pairs of Point-Pixel Pairs for RGB-D Scene Understanding

Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learning

Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View

GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understanding

RePre: Improving Self-Supervised Vision Transformer with Reconstructive Pre-training.

Combining Reconstruction and Contrastive Methods for Multimodal Representations in RL

Joint Generative and Contrastive Learning for Unsupervised Person Re-identification

ReContrast: Domain-Specific Anomaly Detection via Contrastive Reconstruction

ContraNeRF: 3D-Aware Generative Model via Contrastive Learning with Unsupervised Implicit Pose Embedding

3D Shape Contrastive Representation Learning with Adversarial Examples

Contrastive Self-supervised Representation Learning Using Synthetic Data

A Unified Contrastive Loss for Self-Training

SegContrast: 3D Point Cloud Feature Representation Learning Through Self-Supervised Segment Discrimination

OpenCon: Open-world Contrastive Learning

ReC-TTT: Contrastive Feature Reconstruction for Test-Time Training

Contrastive Representation Learning for 3D Protein Structures

Towards a Unified Framework of Contrastive Learning for Disentangled Representations