Abstract:Recently, supervised deep learning has achieved great success in remote sensing images (RSIs) semantic segmentation. However, supervised learning for semantic segmentation requires a large number of labeled samples which is difficult to obtain in the field of remote sensing. A new learning paradigm, self-supervised learning (SSL), can be used to solve such problems by pre-training a general model with large unlabeled images and then fine-tuning on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL, which can learn general invariant features. However, most of the existing contrastive learning is designed for classification tasks to obtain a image-level representation, which may be sub-optimal for semantic segmentation tasks requiring pixel-level discrimination. Therefore, we propose Global style and Local matching Contrastive Learning Network (GLCNet) for remote sensing semantic segmentation. Specifically, 1) The global style contrastive module is used to learn a image-level representation better, as we consider the style features can better represent the overall image features. 2) The local features matching contrastive module is designed to learn representations of local regions which is beneficial for semantic segmentation. We evaluate on four remote sensing semantic segmentation datasets, and the experimental results show that our method mostly outperforms state-of-the-art selfsupervised methods and ImageNet pre-training. Specifically, with 1% annotation from the original dataset, our approach improves Kappa by 6% on the ISPRS Potsdam dataset and 3% on Deep Globe Land Cover Classification dataset relative to the existing baseline. Moreover, our method outperforms supervised learning when there are some differences between the datasets of upstream tasks and downstream tasks. Our study promotes the development of self-supervised learning in the field of remote sensing semantic segmentation. Since SSL could directly learn the essential characteristics of data from unlabeled data which is easy to obtain in remote sensing filed, this may be of great significance for tasks such as global mapping.

TOV: the Original Vision Model for Optical Remote Sensing Image Understanding Via Self-Supervised Learning

TOV : T he O riginal V ision Model for Optical Remote Sensing Image Understanding via Self-Supervised Learning

TOV: the Original Vision Model for Optical Remote Sensing Image Understanding Via Self-supervised Learning

Remote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples

In-Domain Self-Supervised Learning Improves Remote Sensing Image Scene Classification

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method

Index Your Position: A Novel Self-Supervised Learning Method for Remote Sensing Images Semantic Segmentation

Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives

SatVision-TOA: A Geospatial Foundation Model for Coarse-Resolution All-Sky Remote Sensing Imagery

Spatial-Temporal Invariant Contrastive Learning for Remote Sensing Scene Classification

Remote sensing image intelligent interpretation:from supervised learning to self-supervised learning

Pattern Integration and Enhancement Vision Transformer for Self-Supervised Learning in Remote Sensing

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method.

Self-Supervised Learning in Remote Sensing: A review

Advancing Plain Vision Transformer Toward Remote Sensing Foundation Model

A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery

Open-Vocabulary Remote Sensing Image Semantic Segmentation

Reperceive Global Vision of Transformer for Remote Sensing Images Weakly Supervised Object Localization

UniVIP: A Unified Framework for Self-Supervised Visual Pre-training