Abstract:Remote sensing imagery has attracted significant attention in recent years due to its instrumental role in global environmental monitoring, land usage monitoring, and more. As image databases grow each year, performing automatic segmentation with deep learning models has gradually become the standard approach for processing the data. Despite the improved performance of current models, certain limitations remain unresolved. Firstly, training deep learning models for segmentation requires per-pixel annotations. Given the large size of datasets, only a small portion is fully annotated and ready for training. Additionally, the high intra-dataset variance in remote sensing data limits the transfer learning ability of such models. Although recently proposed generic segmentation models like SAM have shown promising results in zero-shot instance-level segmentation, adapting them to semantic segmentation is a non-trivial task. To tackle these challenges, we propose a novel method named Text2Seg for remote sensing semantic segmentation. Text2Seg overcomes the dependency on extensive annotations by employing an automatic prompt generation process using different visual foundation models (VFMs), which are trained to understand semantic information in various ways. This approach not only reduces the need for fully annotated datasets but also enhances the model's ability to generalize across diverse datasets. Evaluations on four widely adopted remote sensing datasets demonstrate that Text2Seg significantly improves zero-shot prediction performance compared to the vanilla SAM model, with relative improvements ranging from 31% to 225%. Our code is available at <a class="link-external link-https" href="https://github.com/Douglas2Code/Text2Seg" rel="external noopener nofollow">this https URL</a>.

Deep Learning Based Semantic Page Segmentation of Document Images in Chinese and English

CNN Based Page Object Detection in Document Images

DeepLayout: A Semantic Segmentation Approach to Page Layout Analysis

A Brief Survey on Semantic Segmentation with Deep Learning

Unsupervised Deep Learning for Handwritten Page Segmentation

Page Segmentation of Chinese Newspapers

Word Segmentation for Chinese Judicial Documents

A Survey of Image Semantic Segmentation Algorithm Based on Deep Learning

Deep Learning for Chinese Word Segmentation and POS Tagging.

Text2Seg: Remote Sensing Image Semantic Segmentation via Text-Guided Visual Foundation Models

RelationNet: Learning Deep-Aligned Representation for Semantic Image Segmentation

A Fusion Framework of Whitespace Smear Cutting and Swin Transformer for Document Layout Analysis

Deep semantic segmentation for visual understanding on construction sites

Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model

DCT-CompSegNet: fast layout segmentation in DCT compressed JPEG document images using deep feature learning

Intelligent Image Semantic Segmentation: A Review Through Deep Learning Techniques for Remote Sensing Image Analysis

Medical Image Semantic Segmentation Based on Deep Learning

Deepstroke: Understanding Glyph Structure With Semantic Segmentation And Tabu Search

Semantic Segmentation of Printed Text from Marathi Document Images using Deep Learning Methods

Review the state-of-the-art technologies of semantic segmentation based on deep learning

Deep-Learning-Based Point Cloud Semantic Segmentation: A Survey