Abstract:Recently, supervised deep learning has achieved a great success in remote sensing image (RSI) semantic segmentation. However, supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. A new learning paradigm, self-supervised learning (SSL), can be used to solve such problems by pretraining a general model with a large number of unlabeled images and then fine-tuning it on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL that can learn general invariant features. However, most existing contrastive learning methods are designed for classification tasks to obtain an image-level representation, which may be suboptimal for semantic segmentation tasks requiring pixel-level discrimination. Therefore, we propose a global style and local matching contrastive learning network (GLCNet) for RSI semantic segmentation. Specifically, first, the global style contrastive learning module is used to better learn an image-level representation, as we consider that style features can better represent the overall image features. Next, the local features matching the contrastive learning module is designed to learn the representations of local regions, which is beneficial for semantic segmentation. We evaluate four RSI semantic segmentation datasets, and the experimental results show that our method mostly outperforms the state-of-the-art self-supervised methods and the ImageNet pretraining method. Specifically, with 1% annotation from the original dataset, our approach improves Kappa by 6% on the International Society for Photogrammetry and Remote Sensing (ISPRS) Potsdam dataset relative to the existing baseline. Moreover, our method outperforms supervised learning methods when there are some differences between the datasets of upstream tasks and downstream tasks. Our study promotes the development of SSL in the field of RSI semantic segmentation. Since SSL could directly learn the essential characteristics of data from unlabeled data, which is easy to obtain in the remote sensing field, this may be of great significance for tasks such as global mapping. The source code is available at https://github.com/GeoX-Lab/G-RSIM .

Self- and Semi-supervised Learning for Gastroscopic Lesion Detection

Real-Time Multi-Label Upper Gastrointestinal Anatomy Recognition from Gastroscope Videos

Category-Level Regularized Unlabeled-to-Labeled Learning for Semi-supervised Prostate Segmentation with Multi-site Unlabeled Data

Semi-Supervised Gastrointestinal Stromal Tumor Detection Via Self-Training

Semi-supervised Gastrointestinal Lesion Segmentation using Adversarial Learning

Semi-Supervised Segmentation Framework for Gastrointestinal Lesion Diagnosis in Endoscopic Images

Supervised Contrastive Learning for Gastrointestinal Lesions Classification in Endoscopic Images

PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentation

Self-supervised learning for gastritis detection with gastric X-ray images

Lesion Detection of Electronic Gastroscope Images Based on Multiscale Texture Feature

Dive into the Details of Self-Supervised Learning for Medical Image Analysis.

SSL-CPCD: Self-supervised learning with composite pretext-class discrimination for improved generalisability in endoscopic image analysis

Self-Supervised Learning for Endoscopic Video Analysis

Improving the Classification Performance of Esophageal Disease on Small Dataset by Semi-supervised Efficient Contrastive Learning

Pseudo Label-Guided Data Fusion and Output Consistency for Semi-Supervised Medical Image Segmentation

Computer-Aided Endoscopic Diagnosis Without Human-Specific Labeling

Global and Local Contrastive Self-Supervised Learning for Semantic Segmentation of HR Remote Sensing Images

Lesion Search with Self-supervised Learning

Improving image classification of gastrointestinal endoscopy using curriculum self-supervised learning

Unsupervised learning for labeling global glomerulosclerosis

Lesion Localization in OCT by Semi-Supervised Object Detection