Abstract:The superiority of deeply learned representations relies on large-scale labeled datasets. However, annotating data are usually expensive or even infeasible in some scenarios. To address this problem, we propose an unsupervised method to leverage instance discrimination and similarity for deep visual representation learning. The method is based on an observation that convolutional neural networks (CNNs) can learn a meaningful visual representation with instancewise classification, in which each instance is treated as an individual class. By this instancewise discriminative learning, instances can reasonably distribute in the representation space, which reveals their similarities. In order to further improve visual representations, we propose a dual-level progressive similar instance selection (DPSIS) method to build a bridge from instance to class by selecting similar instances (neighbors) for each instance (anchor) and treating the anchor and its neighbors as the same class. To be specific, DPSIS adaptively selects two levels of neighbors, that is: 1) an "absolutely similar level" and 2) a "relatively similar level." Instances in the absolutely similar level are used as hard labels, while instances in the relatively similar level are used as soft labels. Moreover, during training, DPSIS is able to progressively select more neighbors without human supervision. At the beginning of training, because CNNs are weak, most instances are distributed relatively randomly in the representation space and only a few easy-to-recognize instances are selected as neighbors. As CNN models become stronger, the semantic meaning of each instance grows clearer. Those instances originally distributed in a relatively random manner gradually move to meaningful positions. This consequently facilitates CNN training since the number of reliable samples increases. Experiments on seven benchmarks, including three small-scale and two large-scale coarse-grained image classification datasets, and two fine-grained categorization datasets, demonstrate the effectiveness of our DPSIS. Our codes have been released at https://github.com/hehefan/DPSIS.

Feature selection and cascade dimensionality reduction for self-supervised visual representation learning

Learning Where to Learn in Cross-View Self-Supervised Learning

Single-image Super-Resolution Via Selective Multi-Scale Network

Embedding Global Contrastive and Local Location in Self-Supervised Learning

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

CVANet: Cascaded visual attention network for single image super-resolution

Siamese Image Modeling for Self-Supervised Vision Representation Learning

UniVIP: A Unified Framework for Self-Supervised Visual Pre-training

DATA: Domain-Aware and Task-Aware Self-supervised Learning

Learning What and Where to Learn: A New Perspective on Self-supervised Learning

On the Discriminability of Self-Supervised Representation Learning

Adjustable Super-Resolution Network Via Deep Supervised Learning and Progressive Self-Distillation

Cascade Network for Self-Supervised Monocular Depth Estimation

Cascaded panoptic segmentation method for high resolution remote sensing image

Unsupervised Visual Representation Learning via Dual-Level Progressive Similar Instance Selection

CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding

Dynamic image super-resolution via progressive contrastive self-distillation

A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis

Self-attention learning network for face super-resolution

Self-supervised Pre-training via Multi-modality Images with Transformer for Change Detection

SiSL-Net: Saliency-guided self-supervised learning network for image classification