Abstract:Recently, supervised deep learning has achieved great success in remote sensing images (RSIs) semantic segmentation. However, supervised learning for semantic segmentation requires a large number of labeled samples which is difficult to obtain in the field of remote sensing. A new learning paradigm, self-supervised learning (SSL), can be used to solve such problems by pre-training a general model with large unlabeled images and then fine-tuning on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL, which can learn general invariant features. However, most of the existing contrastive learning is designed for classification tasks to obtain a image-level representation, which may be sub-optimal for semantic segmentation tasks requiring pixel-level discrimination. Therefore, we propose Global style and Local matching Contrastive Learning Network (GLCNet) for remote sensing semantic segmentation. Specifically, 1) The global style contrastive module is used to learn a image-level representation better, as we consider the style features can better represent the overall image features. 2) The local features matching contrastive module is designed to learn representations of local regions which is beneficial for semantic segmentation. We evaluate on four remote sensing semantic segmentation datasets, and the experimental results show that our method mostly outperforms state-of-the-art selfsupervised methods and ImageNet pre-training. Specifically, with 1% annotation from the original dataset, our approach improves Kappa by 6% on the ISPRS Potsdam dataset and 3% on Deep Globe Land Cover Classification dataset relative to the existing baseline. Moreover, our method outperforms supervised learning when there are some differences between the datasets of upstream tasks and downstream tasks. Our study promotes the development of self-supervised learning in the field of remote sensing semantic segmentation. Since SSL could directly learn the essential characteristics of data from unlabeled data which is easy to obtain in remote sensing filed, this may be of great significance for tasks such as global mapping.

Learning Where to Learn in Cross-View Self-Supervised Learning

Learning What and Where to Learn: A New Perspective on Self-supervised Learning

Embedding Global Contrastive and Local Location in Self-Supervised Learning

Cross-View Recurrence-based Self-Supervised Super-Resolution of Light Field

Spatiotemporal Self-supervised Learning for Point Clouds in the Wild

On the Discriminability of Self-Supervised Representation Learning

Weak Augmentation Guided Relational Self-Supervised Learning

Single-branch Self-Supervised Learning with Hybrid Tasks

Understanding and Improving the Role of Projection Head in Self-Supervised Learning

S4: Self-Supervised Learning with Sparse-dense Sampling

De-coupling and De-positioning Dense Self-supervised Learning

Addressing Sample Inefficiency in Multi-View Representation Learning

Deciphering the Projection Head: Representation Evaluation Self-supervised Learning

Global-and-Local Sampling for Efficient Hybrid Task Self-Supervised Learning.

Feature selection and cascade dimensionality reduction for self-supervised visual representation learning

LESSL: Can LEGO Sampling and Collaborative Optimization Contribute to Self-Supervised Learning?

MSR: Making Self-supervised learning Robust to Aggressive Augmentations

Self-supervised Feature Learning by Cross-modality and Cross-view Correspondences

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method

Boundary-Enhanced Self-supervised Learning for Brain Structure Segmentation

Understanding self-supervised Learning Dynamics without Contrastive Pairs