Abstract:To address the challenge of requiring a large amount of manually annotated data for semantic segmentation of remote sensing images using deep learning, a method based on self-supervised learning is proposed. Firstly, to simultaneously learn the global and local features of remote sensing images, a self-supervised learning network structure called TBSNet (Triple-Branch Self-supervised Network) is constructed. This network comprises an image transformation prediction branch, a global contrastive learning branch, and a local contrastive learning branch. The contrastive learning part of the network employs a novel data augmentation method to simulate positive pairs of the same remote sensing images under different weather conditions, enhancing the model's performance. Meanwhile, the model integrates channel attention and spatial attention mechanisms in the projection head structure of the global contrastive learning branch, and replaces a fully connected layer with a convolutional layer in the local contrastive learning branch, thus improving the model's feature extraction ability. Secondly, to mitigate the high computational cost during the pre-training phase, an algorithm optimization strategy is proposed using the TracIn method and sequential optimization theory, which increases the efficiency of pre-training. Lastly, by fine-tuning the model with a small amount of annotated data, effective semantic segmentation of remote sensing images is achieved even with limited annotated data. The experimental results indicate that with only 10% annotated data, the overall accuracy (OA) and recall of this model have improved by 4.60% and 4.88% respectively, compared to the traditional self-supervised model SimCLR (A Simple Framework for Contrastive Learning of Visual Representations). This provides significant application value for tasks such as semantic segmentation in remote sensing imagery and other computer vision domains.

Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions

Semi-Supervised Pixel-Level Scene Text Segmentation by Mutually Guided Network

Looking from a Higher-Level Perspective: Attention and Recognition Enhanced Multi-scale Scene Text Segmentation.

Mixed-Supervised Scene Text Detection With Expectation-Maximization Algorithm

Integrated Image-Text Based on Semi-supervised Learning for Small Sample Instance Segmentation

Multi-oriented Scene Text Detection via Corner Localization and Region Segmentation

A Creative Weak Supervised Semantic Segmentation for Remote Sensing Images

Text Detection in Scene Images Based on Exhaustive Segmentation

Self-Supervised Pre-training with Symmetric Superimposition Modeling for Scene Text Recognition

SemiText: Scene Text Detection with Semi-Supervised Learning

Background-Insensitive Scene Text Recognition with Text Semantic Segmentation

Texts as Points: Scene Text Detection with Point Supervision

Text2Seg: Remote Sensing Image Semantic Segmentation via Text-Guided Visual Foundation Models

Associating Spatially-Consistent Grouping with Text-supervised Semantic Segmentation

Weakly-Supervised Text Instance Segmentation

An Efficient Scene Text Spotter with a Feature-Level Super-Resolution Module

WAS: Dataset and Methods for Artistic Text Segmentation

Unambiguous Scene Text Segmentation with Referring Expression Comprehension

Research on Semantic Segmentation Method of Remote Sensing Image Based on Self-supervised Learning

Open-Vocabulary Segmentation with Unpaired Mask-Text Supervision

Fully Self-Supervised Learning for Semantic Segmentation