Abstract:Unsupervised feature learning has made great strides with contrastive learning based on instance discrimination and invariant mapping, as benchmarked on curated class-balanced datasets. However, natural data could be highly correlated and long-tail distributed. Natural between-instance similarity conflicts with the presumed instance distinction, causing unstable training and poor performance. Our idea is to discover and integrate between-instance similarity into contrastive learning, not directly by instance grouping, but by cross-level discrimination (CLD) between instances and local instance groups. While invariant mapping of each instance is imposed by attraction within its augmented views, between-instance similarity could emerge from common repulsion against instance groups. Our batch-wise and cross-view comparisons also greatly improve the positive/negative sample ratio of contrastive learning and achieve better invariant mapping. To effect both grouping and discrimination objectives, we impose them on features separately derived from a shared representation. In addition, we propose normalized projection heads and unsupervised hyper-parameter tuning for the first time. Our extensive experimentation demonstrates that CLD is a lean and powerful add-on to existing methods such as NPID, MoCo, InfoMin, and BYOL on highly correlated, long-tail, or balanced datasets. It not only achieves new state-of-the-art on self-supervision, semi-supervision, and transfer learning benchmarks, but also beats MoCo v2 and SimCLR on every reported performance attained with a much larger compute. CLD effectively brings unsupervised learning closer to natural data and real-world applications. Our code is publicly available at: <a class="link-external link-https" href="https://github.com/frank-xwang/CLD-UnsupervisedLearning" rel="external noopener nofollow">this https URL</a>.

Self-supervised Cross-stage Regional Contrastive Learning for Object Detection.

Dense Contrastive Learning for Self-Supervised Visual Pre-Training

Space-correlated Contrastive Representation Learning with Multiple Instances.

Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination

DenseCL: A Simple Framework for Self-Supervised Dense Visual Pre-Training

Align Yourself: Self-supervised Pre-training for Fine-grained Recognition via Saliency Alignment.

Supervised contrastive learning with multi-scale interaction and integrity learning for salient object detection

Weakly Supervised Region-Level Contrastive Learning for Efficient Object Detection.

Unsupervised learning based object detection using Contrastive Learning

Self-Supervised Global–Local Contrastive Learning for Fine-Grained Change Detection in VHR Images

RegionCL: Exploring Contrastive Region Pairs for Self-supervised Representation Learning

Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

Point-Level Region Contrast for Object Detection Pre-Training

Self-Supervised Intra-Modal and Cross-Modal Contrastive Learning for Point Cloud Understanding

Semi-supervised Contrastive Learning with Similarity Co-calibration.

Cross-Modal Self-Supervised Learning with Effective Contrastive Units for LiDAR Point Clouds

Self-supervised Feature Learning by Cross-modality and Cross-view Correspondences

Graph-Based Contrastive Learning for Description and Detection of Local Features.

RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning?

Multi-Level Contrastive Learning for Dense Prediction Task

Weakly-supervised Contrastive Learning for Unsupervised Object Discovery