Abstract:Remote sensing imagery has attracted significant attention in recent years due to its instrumental role in global environmental monitoring, land usage monitoring, and more. As image databases grow each year, performing automatic segmentation with deep learning models has gradually become the standard approach for processing the data. Despite the improved performance of current models, certain limitations remain unresolved. Firstly, training deep learning models for segmentation requires per-pixel annotations. Given the large size of datasets, only a small portion is fully annotated and ready for training. Additionally, the high intra-dataset variance in remote sensing data limits the transfer learning ability of such models. Although recently proposed generic segmentation models like SAM have shown promising results in zero-shot instance-level segmentation, adapting them to semantic segmentation is a non-trivial task. To tackle these challenges, we propose a novel method named Text2Seg for remote sensing semantic segmentation. Text2Seg overcomes the dependency on extensive annotations by employing an automatic prompt generation process using different visual foundation models (VFMs), which are trained to understand semantic information in various ways. This approach not only reduces the need for fully annotated datasets but also enhances the model's ability to generalize across diverse datasets. Evaluations on four widely adopted remote sensing datasets demonstrate that Text2Seg significantly improves zero-shot prediction performance compared to the vanilla SAM model, with relative improvements ranging from 31% to 225%. Our code is available at <a class="link-external link-https" href="https://github.com/Douglas2Code/Text2Seg" rel="external noopener nofollow">this https URL</a>.

Text Segmentation as a Supervised Learning Task

RWMS: Reliable Weighted Multi-Phase for Semi-supervised Segmentation

Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions

Training-Free Semantic Segmentation via LLM-Supervision

Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation

Weakly-Supervised Text Instance Segmentation

Recent Trends in Linear Text Segmentation: a Survey

A Creative Weak Supervised Semantic Segmentation for Remote Sensing Images

Unsupervised Word Segmentation Using Temporal Gradient Pseudo-Labels

Text2Seg: Remote Sensing Image Semantic Segmentation via Text-Guided Visual Foundation Models

Unsupervised Learning helps Supervised Neural Word Segmentation

Text4Seg: Reimagining Image Segmentation as Text Generation

A Simple Framework for Text-Supervised Semantic Segmentation

Semi-Supervised Pixel-Level Scene Text Segmentation by Mutually Guided Network

Unsupervised Domain Adaptation for Semantic Image Segmentation: a Comprehensive Survey

Structured Summarization: Unified Text Segmentation and Segment Labeling as a Generation Task

Unsupervised Domain Adaptation for Referring Semantic Segmentation

Open-Vocabulary Segmentation with Unpaired Mask-Text Supervision

OntoSeg: a Novel Approach to Text Segmentation using Ontological Similarity

Large-scale Unsupervised Semantic Segmentation

Enhancing Chinese Word Segmentation Using Unlabeled Data