Abstract:Contrastive learning techniques make it possible to pretrain a general model in a self-supervised paradigm using a large number of unlabeled remote sensing images. The core idea is to pull positive samples defined by data augmentation techniques closer together while pushing apart randomly sampled negative samples to serve as supervised learning signals. This strategy is based on the strict identity hypothesis, i.e., positive samples are strictly defined by each (anchor) sample's own augmentation transformation. However, this leads to the over-instancing of the features learned by the model and the loss of the ability to fully identify ground objects. Therefore, we proposed a relaxed identity hypothesis governing the feature distribution of different instances within the same class of features. The implementation of the relaxed identity hypothesis requires the sampling and discrimination of the relaxed identical samples. In this study, to realize the sampling of relaxed identical samples under the unsupervised learning paradigm, the remote sensing image was used to show that nearby objects often present a large correlation; neighborhood sampling was carried out around the anchor sample; and the similarity between the sampled samples and the anchor samples was defined as the semantic similarity. To achieve sample discrimination under the relaxed identity hypothesis, the feature loss was calculated and reordered for the samples in the relaxed identical sample queue and the anchor samples, and the feature loss between the anchor samples and the sample queue was defined as the feature similarity. Through the sampling and discrimination of the relaxed identical samples, the leap from instance-level features to class-level features was achieved to a certain extent while enhancing the network's invariant learning of features. We validated the effectiveness of the proposed method on three datasets, and our method achieved the best experimental results on all three datasets compared to six self-supervised methods.

RSDNE: Exploring Relaxed Similarity and Dissimilarity from Completely-Imbalanced Labels for Network Embedding.

Network Embedding with Completely-Imbalanced Labels

Extending LINE for Network Embedding with Completely Imbalanced Labels

RiSSNet: Contrastive Learning Network with a Relaxed Identity Sampling Strategy for Remote Sensing Image Semantic Segmentation

Local Neighborhood Embedding for Unsupervised Nonlinear Dimension Reduction.

SEPL-Net: A Semantics-Enhanced Pseudo Labeling Network for Semi-Supervised Image Analysis

The Network Representation Learning Algorithm Based on Semi-Supervised Random Walk

PNE: Label Embedding Enhanced Network Embedding.

Adaptive Local Embedding Learning for Semi-Supervised Dimensionality Reduction

Local Structural Aware Heterogeneous Information Network Embedding Based on Relational Self-Attention Graph Neural Network

Learning Distributed Representations for Recommender Systems with a Network Embedding Approach

Sentiment Analysis Based on Heterogeneous Multi-Relation Signed Network

Deep Recursive Network Embedding With Regular Equivalence

Semi-Supervised Remote-Sensing Image Scene Classification Using Representation Consistency Siamese Network

Bringing Order to Network Embedding: A Relative Ranking based Approach

A Structure-Enriched Neural Network for Network Embedding.

Semisupervised Graph Embedding and Spatial Neighbor-Based Discriminant Analysis

Learning Network Representations with Neighboring Affinity

Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network

LDSNE: Learning Structural Network Embeddings by Encoding Local Distances

Enhancing Network Embedding with Implicit Clustering