Abstract:Remote sensing imagery has attracted significant attention in recent years due to its instrumental role in global environmental monitoring, land usage monitoring, and more. As image databases grow each year, performing automatic segmentation with deep learning models has gradually become the standard approach for processing the data. Despite the improved performance of current models, certain limitations remain unresolved. Firstly, training deep learning models for segmentation requires per-pixel annotations. Given the large size of datasets, only a small portion is fully annotated and ready for training. Additionally, the high intra-dataset variance in remote sensing data limits the transfer learning ability of such models. Although recently proposed generic segmentation models like SAM have shown promising results in zero-shot instance-level segmentation, adapting them to semantic segmentation is a non-trivial task. To tackle these challenges, we propose a novel method named Text2Seg for remote sensing semantic segmentation. Text2Seg overcomes the dependency on extensive annotations by employing an automatic prompt generation process using different visual foundation models (VFMs), which are trained to understand semantic information in various ways. This approach not only reduces the need for fully annotated datasets but also enhances the model's ability to generalize across diverse datasets. Evaluations on four widely adopted remote sensing datasets demonstrate that Text2Seg significantly improves zero-shot prediction performance compared to the vanilla SAM model, with relative improvements ranging from 31% to 225%. Our code is available at <a class="link-external link-https" href="https://github.com/Douglas2Code/Text2Seg" rel="external noopener nofollow">this https URL</a>.

Texture segmentation for remote sensing image based on texture-topic model

An Efficient Texture Image Segmentation Algorithm Based on the GMRF Model for Classification of Remotely Sensed Imagery

Text2Seg: Remote Sensing Image Semantic Segmentation via Text-Guided Visual Foundation Models

Incorporating DeepLabv3+and Object-Based Image Analysis for Semantic Segmentation of Very High Resolution Remote Sensing Images

Unsupervised Texture Segmentation Via Applying Geodesic Active Regions To Gaborian Feature Space

Segmentation of VHR EO Images using Unsupervised Learning

A new segmentation method for very high resolution imagery using spectral and morphological information

Color Texture Image Segmentation Using Chromatic Statistical Landscape Features

SAR Image Segmentation Based on Hierarchical Visual Semantic and Adaptive Neighborhood Multinomial Latent Model

The Extraction of Plantation with Texture Feature in High Resolution Remote Sensing Image

A Creative Weak Supervised Semantic Segmentation for Remote Sensing Images

Edge-Preserving Texture-Based Semantic Segmentation for Ultrahigh Resolution Images in Agricultural Scene

Multi-modal remote sensing image segmentation based on attention-driven dual-branch encoding framework

Very High Resolution Image Segmentation by Combined Spectral and Structural Information

Classification of Landsat 7 ETM+ Imagery in Western Mountainous Area of Zhejiang Based on Gray-Gradient Co-Concurrency Matrix

Multispectral quickbird-2 image segmentation based on vector field model

Unsupervised Texture Segmentation Using Resonance Algorithm For Natural Scenes

Semi-supervised Remote Sensing Image Segmentation Using Dynamic Region Merging.

Multi-Scale LBP Texture Feature Learning Network for Remote Sensing Interpretation of Land Desertification

The Research of Object-oriented Classification Method in Remote Sensing Image with Texture Analysis——Taking Yangling County of Shanxi Province as an Example

Land Cover Classification of Resources Survey Remote Sensing Images Based on Segmentation Model