Abstract:Recently, supervised deep learning has achieved great success in remote sensing images (RSIs) semantic segmentation. However, supervised learning for semantic segmentation requires a large number of labeled samples which is difficult to obtain in the field of remote sensing. A new learning paradigm, self-supervised learning (SSL), can be used to solve such problems by pre-training a general model with large unlabeled images and then fine-tuning on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL, which can learn general invariant features. However, most of the existing contrastive learning is designed for classification tasks to obtain a image-level representation, which may be sub-optimal for semantic segmentation tasks requiring pixel-level discrimination. Therefore, we propose Global style and Local matching Contrastive Learning Network (GLCNet) for remote sensing semantic segmentation. Specifically, 1) The global style contrastive module is used to learn a image-level representation better, as we consider the style features can better represent the overall image features. 2) The local features matching contrastive module is designed to learn representations of local regions which is beneficial for semantic segmentation. We evaluate on four remote sensing semantic segmentation datasets, and the experimental results show that our method mostly outperforms state-of-the-art selfsupervised methods and ImageNet pre-training. Specifically, with 1% annotation from the original dataset, our approach improves Kappa by 6% on the ISPRS Potsdam dataset and 3% on Deep Globe Land Cover Classification dataset relative to the existing baseline. Moreover, our method outperforms supervised learning when there are some differences between the datasets of upstream tasks and downstream tasks. Our study promotes the development of self-supervised learning in the field of remote sensing semantic segmentation. Since SSL could directly learn the essential characteristics of data from unlabeled data which is easy to obtain in remote sensing filed, this may be of great significance for tasks such as global mapping.

Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method.

Research on Semantic Segmentation Method of Remote Sensing Image Based on Self-supervised Learning

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method

Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net

Label Propagation and Contrastive Regularization for Semisupervised Semantic Segmentation of Remote Sensing Images

C3T: Contrastive Consistency Cross-Network Learning for Semi-Supervised Semantic Segmentation

RiSSNet: Contrastive Learning Network with a Relaxed Identity Sampling Strategy for Remote Sensing Image Semantic Segmentation

Semi-Supervised Adversarial Semantic Segmentation Network Using Transformer and Multiscale Convolution for High-Resolution Remote Sensing Imagery

Semi-Supervised Remote Sensing Image Semantic Segmentation Via Consistency Regularization And Average Update Of Pseudo-Label

DMF-CL: Dense Multi-scale Feature Contrastive Learning for Semantic Segmentation of Remote-Sensing Images

Confidence-Weighted Dual-Teacher Networks With Biased Contrastive Learning for Semi-Supervised Semantic Segmentation in Remote Sensing Images

Semisupervised Multiscale Generative Adversarial Network for Semantic Segmentation of Remote Sensing Image.

High-resolution Remote Sensing Image Semantic Segmentation Based on Semi-Supervised Full Convolution Network Method

Region-Aware Contrastive Learning for Semi-Supervised Semantic Segmentation of Remote Sensing Images

Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

Semi-supervised Semantic Labeling of Remote Sensing Images with Improved Image-Level Selection Retraining

Semisupervised Semantic Segmentation of Remote Sensing Images With Consistency Self-Training

Dual Path Attention Net For Remote Sensing Semantic Image Segmentation

Semantic Segmentation of Remote Sensing Images Using Transfer Learning and Deep Convolutional Neural Network With Dense Connection

A New Multi-Channel Deep Convolutional Neural Network for Semantic Segmentation of Remote Sensing Image.