Abstract:Recently, supervised deep learning has achieved great success in remote sensing images (RSIs) semantic segmentation. However, supervised learning for semantic segmentation requires a large number of labeled samples which is difficult to obtain in the field of remote sensing. A new learning paradigm, self-supervised learning (SSL), can be used to solve such problems by pre-training a general model with large unlabeled images and then fine-tuning on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL, which can learn general invariant features. However, most of the existing contrastive learning is designed for classification tasks to obtain a image-level representation, which may be sub-optimal for semantic segmentation tasks requiring pixel-level discrimination. Therefore, we propose Global style and Local matching Contrastive Learning Network (GLCNet) for remote sensing semantic segmentation. Specifically, 1) The global style contrastive module is used to learn a image-level representation better, as we consider the style features can better represent the overall image features. 2) The local features matching contrastive module is designed to learn representations of local regions which is beneficial for semantic segmentation. We evaluate on four remote sensing semantic segmentation datasets, and the experimental results show that our method mostly outperforms state-of-the-art selfsupervised methods and ImageNet pre-training. Specifically, with 1% annotation from the original dataset, our approach improves Kappa by 6% on the ISPRS Potsdam dataset and 3% on Deep Globe Land Cover Classification dataset relative to the existing baseline. Moreover, our method outperforms supervised learning when there are some differences between the datasets of upstream tasks and downstream tasks. Our study promotes the development of self-supervised learning in the field of remote sensing semantic segmentation. Since SSL could directly learn the essential characteristics of data from unlabeled data which is easy to obtain in remote sensing filed, this may be of great significance for tasks such as global mapping.

Remote sensing image intelligent interpretation:from supervised learning to self-supervised learning

Remote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples

Self-Supervised Remote Sensing Feature Learning: Learning Paradigms, Challenges, and Future Works

Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives

Self-Supervised Learning in Remote Sensing: A review

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method

A Survey on Deep Learning-Driven Remote Sensing Image Scene Understanding: Scene Classification, Scene Retrieval and Scene-Guided Object Detection

Research on Semantic Segmentation Method of Remote Sensing Image Based on Self-supervised Learning

Deep Learning and Remote Sensing Data Analysis

Object Detection for Optical Remote Sensing Images with Self-supervised Feature Representation

Supervised and Contrastive Self-Supervised In-Domain Representation Learning for Dense Prediction Problems in Remote Sensing

Deep Learning-based Semantic Segmentation of Remote Sensing Images: A Survey

Self-supervised in-domain representation learning for remote sensing image scene classification

Simple and Efficient: A Semisupervised Learning Framework for Remote Sensing Image Semantic Segmentation

The Design of Deep Learning Framework and Model for Intelligent Remote Sensing

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method.

Color-Aware Self-Supervised Learning for Scene Classification and Segmentation of Remote Sensing Images.

A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery

SiamSeg: Self-Training with Contrastive Learning for Unsupervised Domain Adaptation in Remote Sensing

Semantic Segmentation of Remote Sensing Images With Self-Supervised Multitask Representation Learning