Abstract:Recently, supervised deep learning has achieved great success in remote sensing images (RSIs) semantic segmentation. However, supervised learning for semantic segmentation requires a large number of labeled samples which is difficult to obtain in the field of remote sensing. A new learning paradigm, self-supervised learning (SSL), can be used to solve such problems by pre-training a general model with large unlabeled images and then fine-tuning on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL, which can learn general invariant features. However, most of the existing contrastive learning is designed for classification tasks to obtain a image-level representation, which may be sub-optimal for semantic segmentation tasks requiring pixel-level discrimination. Therefore, we propose Global style and Local matching Contrastive Learning Network (GLCNet) for remote sensing semantic segmentation. Specifically, 1) The global style contrastive module is used to learn a image-level representation better, as we consider the style features can better represent the overall image features. 2) The local features matching contrastive module is designed to learn representations of local regions which is beneficial for semantic segmentation. We evaluate on four remote sensing semantic segmentation datasets, and the experimental results show that our method mostly outperforms state-of-the-art selfsupervised methods and ImageNet pre-training. Specifically, with 1% annotation from the original dataset, our approach improves Kappa by 6% on the ISPRS Potsdam dataset and 3% on Deep Globe Land Cover Classification dataset relative to the existing baseline. Moreover, our method outperforms supervised learning when there are some differences between the datasets of upstream tasks and downstream tasks. Our study promotes the development of self-supervised learning in the field of remote sensing semantic segmentation. Since SSL could directly learn the essential characteristics of data from unlabeled data which is easy to obtain in remote sensing filed, this may be of great significance for tasks such as global mapping.

S4: Self-Supervised Learning with Sparse-dense Sampling

Point Contrastive Prediction with Semantic Clustering for Self-Supervised Learning on Point Cloud Videos

LESSL: Can LEGO Sampling and Collaborative Optimization Contribute to Self-Supervised Learning?

Learning Where to Learn in Cross-View Self-Supervised Learning

Learning What and Where to Learn: A New Perspective on Self-supervised Learning

Dense Semantic Contrast for Self-Supervised Visual Representation Learning

Rethinking Self-Supervised Learning: Small is Beautiful

Single-branch Self-Supervised Learning with Hybrid Tasks

Towards the Sparseness of Projection Head in Self-Supervised Learning.

Global-and-Local Sampling for Efficient Hybrid Task Self-Supervised Learning.

Spatiotemporal Self-supervised Learning for Point Clouds in the Wild

Feature selection and cascade dimensionality reduction for self-supervised visual representation learning

On the Discriminability of Self-Supervised Representation Learning

Dense Contrastive Learning for Self-Supervised Visual Pre-Training

Pretrain a Remote Sensing Foundation Model by Promoting Intra-instance Similarity

Self-Supervised Learning across the Spectrum

Embedding Global Contrastive and Local Location in Self-Supervised Learning

Self-supervised Learning is More Robust to Dataset Imbalance

On Improving the Algorithm-, Model-, and Data- Efficiency of Self-Supervised Learning

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method.