Abstract:Recently, supervised deep learning has achieved great success in remote sensing images (RSIs) semantic segmentation. However, supervised learning for semantic segmentation requires a large number of labeled samples which is difficult to obtain in the field of remote sensing. A new learning paradigm, self-supervised learning (SSL), can be used to solve such problems by pre-training a general model with large unlabeled images and then fine-tuning on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL, which can learn general invariant features. However, most of the existing contrastive learning is designed for classification tasks to obtain a image-level representation, which may be sub-optimal for semantic segmentation tasks requiring pixel-level discrimination. Therefore, we propose Global style and Local matching Contrastive Learning Network (GLCNet) for remote sensing semantic segmentation. Specifically, 1) The global style contrastive module is used to learn a image-level representation better, as we consider the style features can better represent the overall image features. 2) The local features matching contrastive module is designed to learn representations of local regions which is beneficial for semantic segmentation. We evaluate on four remote sensing semantic segmentation datasets, and the experimental results show that our method mostly outperforms state-of-the-art selfsupervised methods and ImageNet pre-training. Specifically, with 1% annotation from the original dataset, our approach improves Kappa by 6% on the ISPRS Potsdam dataset and 3% on Deep Globe Land Cover Classification dataset relative to the existing baseline. Moreover, our method outperforms supervised learning when there are some differences between the datasets of upstream tasks and downstream tasks. Our study promotes the development of self-supervised learning in the field of remote sensing semantic segmentation. Since SSL could directly learn the essential characteristics of data from unlabeled data which is easy to obtain in remote sensing filed, this may be of great significance for tasks such as global mapping.

Research on Semantic Segmentation Method of Remote Sensing Image Based on Self-supervised Learning

Semantic Segmentation of Remote Sensing Images With Self-Supervised Multitask Representation Learning

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method.

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method

Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network

Simple and Efficient: A Semisupervised Learning Framework for Remote Sensing Image Semantic Segmentation

Semi-supervised Semantic Labeling of Remote Sensing Images with Improved Image-Level Selection Retraining

Semisupervised Semantic Segmentation of Remote Sensing Images With Consistency Self-Training

DMF-CL: Dense Multi-scale Feature Contrastive Learning for Semantic Segmentation of Remote-Sensing Images

Semi-Supervised Remote Sensing Image Semantic Segmentation Method Based on Deep Learning

Semi-Supervised Deep learning via Transformation Consistency Regularization for Remote Sensing Image Semantic Segmentation

Confidence-Weighted Dual-Teacher Networks With Biased Contrastive Learning for Semi-Supervised Semantic Segmentation in Remote Sensing Images

Semi-Supervised Adversarial Semantic Segmentation Network Using Transformer and Multiscale Convolution for High-Resolution Remote Sensing Imagery

Region-Aware Contrastive Learning for Semi-Supervised Semantic Segmentation of Remote Sensing Images

A Creative Weak Supervised Semantic Segmentation for Remote Sensing Images

Task Specific Pretraining with Noisy Labels for Remote Sensing Image Segmentation

A bidirectional semantic segmentation method for remote sensing image based on super-resolution and domain adaptation

Label Propagation and Contrastive Regularization for Semisupervised Semantic Segmentation of Remote Sensing Images

A New Semisupervised Method for Detecting Semantic Changes in Remote Sensing Images.

Improving Semantic Segmentation via Self-Training