Abstract:Contrastive learning has recently demonstrated great potential for unsupervised pre-training in 3D scene understanding tasks. However, most existing work randomly selects point features as anchors while building contrast, leading to a clear bias toward background points that often dominate in 3D scenes. Also, object awareness and foreground-to-background discrimination are neglected, making contrastive learning less effective. To tackle these issues, we propose a general foreground-aware feature contrast FAC++ framework to learn more effective point cloud representations in pre-training. FAC++ consists of two novel contrast designs to construct more effective and informative contrast pairs. The first is building positive pairs within the same foreground segment where points tend to have the same semantics. The second is that we prevent over-discrimination between 3D segments/objects and encourage grouped foreground-to-background distinctions at the segment level with adaptive feature learning in a Siamese correspondence network, which adaptively learns feature correlations within and across point cloud views effectively. Moreover, we have designed the foreground-prompted regional sampling to enhance more balanced foreground-aware learning, which is termed FAC++. Visualization with point activation maps shows that our contrast pairs capture clear correspondences among foreground regions during pre-training. Quantitative experiments also show that FAC++ achieves superior knowledge transfer and data efficiency in various downstream 3D semantic segmentation, instance segmentation as well as object detection tasks. All codes, data, and models are available at: <a class="link-external link-https" href="https://github.com/KangchengLiu/FAC_Foreground_Aware_Contrast" rel="external noopener nofollow">this https URL</a>

Feature-Suppressed Contrast for Self-Supervised Food Pre-training

Point Contrastive Prediction with Semantic Clustering for Self-Supervised Learning on Point Cloud Videos

Saliency Guided Contrastive Learning on Scene Images

Align Yourself: Self-supervised Pre-training for Fine-grained Recognition via Saliency Alignment.

FMiFood: Multi-modal Contrastive Learning for Food Image Classification

Dense Contrastive Learning for Self-Supervised Visual Pre-Training

DenseCL: A Simple Framework for Self-Supervised Dense Visual Pre-Training

Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning

Boost Supervised Pretraining for Visual Transfer Learning: Implications of Self-Supervised Contrastive Representation Learning.

Self-Supervised Visual Representation Learning on Food Images

Improving Contrastive Learning by Visualizing Feature Transformation

Generalized 3D Self-supervised Learning Framework via Prompted Foreground-Aware Feature Contrast

MixCL: Pixel label matters to contrastive learning

P4Contrast: Contrastive Learning with Pairs of Point-Pixel Pairs for RGB-D Scene Understanding

From Pretext to Purpose: Batch-Adaptive Self-Supervised Learning

Semantic Center Guided Windows Attention Fusion Framework for Food Recognition

Self-supervised extracted contrast network for facial expression recognition

Resource and data efficient self supervised learning

Learning Using Privileged Information for Food Recognition

Few-shot Food Recognition with Pre-trained Model.

Object-aware Contrastive Learning for Debiased Scene Representation