Abstract:Recently, supervised deep learning has achieved great success in remote sensing images (RSIs) semantic segmentation. However, supervised learning for semantic segmentation requires a large number of labeled samples which is difficult to obtain in the field of remote sensing. A new learning paradigm, self-supervised learning (SSL), can be used to solve such problems by pre-training a general model with large unlabeled images and then fine-tuning on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL, which can learn general invariant features. However, most of the existing contrastive learning is designed for classification tasks to obtain a image-level representation, which may be sub-optimal for semantic segmentation tasks requiring pixel-level discrimination. Therefore, we propose Global style and Local matching Contrastive Learning Network (GLCNet) for remote sensing semantic segmentation. Specifically, 1) The global style contrastive module is used to learn a image-level representation better, as we consider the style features can better represent the overall image features. 2) The local features matching contrastive module is designed to learn representations of local regions which is beneficial for semantic segmentation. We evaluate on four remote sensing semantic segmentation datasets, and the experimental results show that our method mostly outperforms state-of-the-art selfsupervised methods and ImageNet pre-training. Specifically, with 1% annotation from the original dataset, our approach improves Kappa by 6% on the ISPRS Potsdam dataset and 3% on Deep Globe Land Cover Classification dataset relative to the existing baseline. Moreover, our method outperforms supervised learning when there are some differences between the datasets of upstream tasks and downstream tasks. Our study promotes the development of self-supervised learning in the field of remote sensing semantic segmentation. Since SSL could directly learn the essential characteristics of data from unlabeled data which is easy to obtain in remote sensing filed, this may be of great significance for tasks such as global mapping.

Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining

Multilabel-Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining

SSL4EO-S12: A Large-Scale Multi-Modal, Multi-Temporal Dataset for Self-Supervised Learning in Earth Observation

Contrastive Learning Based on Multiscale Hard Features for Remote-Sensing Image Scene Classification.

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method.

Multi-Source Remote Sensing Pretraining Based on Contrastive Self-Supervised Learning

Saliency Guided Contrastive Learning on Scene Images

Multiple Embeddings Contrastive Pretraining for Remote Sensing Image Classification

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method

Self-supervised Audiovisual Representation Learning for Remote Sensing Data

SSL4EO-S12: A large-scale multimodal, multitemporal dataset for self-supervised learning in Earth observation [Software and Data Sets]

Multimodal Supervised Contrastive Learning in Remote Sensing Downstream Tasks

Research on Semantic Segmentation Method of Remote Sensing Image Based on Self-supervised Learning

Self-Supervised Classification of SAR Images with Optical Image Assistance

SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery

Consecutive Pre-Training: A Knowledge Transfer Learning Strategy with Relevant Unlabeled Data for Remote Sensing Domain

Spatial and Semantic Consistency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

Building a Strong Pre-Training Baseline for Universal 3D Large-Scale Perception

Task Specific Pretraining with Noisy Labels for Remote Sensing Image Segmentation

CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representations

MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learning