Abstract:In the era of increasingly advanced Earth Observation (EO) technologies, extracting pertinent information (such as water-bodies) from the Earth's surface has become a crucial task. Deep Learning, especially via pre-trained models, currently offers a highly promising approach for the semantic segmentation of Remote Sensing Imagery (RSI). However, effectively adapting these pre-trained models to RSI tasks remains challenging. Typically, these models undergo fine-tuning for specialized tasks, involving modifications to their parameters or structure of the original architecture, which may impact their inherent generalization capabilities. Furthermore, robust pre-trained models on nature images are not specifically designed for RSI, presenting challenges in their direct application to RSI tasks. To alleviate these problems, our study introduces a light-weight Enhanced Semantic-positional Feature Fusion Network (ESFFNet), leveraging diverse pre-trained image encoders alongside extensive EO data. The proposed method begins by leveraging pre-trained encoders, specifically Vision Transformer (ViT)-based and Convolutional Neural Network (CNN)-based models, to extract deep semantic and precise positional features respectively, without additional training. Following this, we introduce the Enhanced Semantic-positional Feature Fusion Module (ESFFM). This module adeptly merges semantic features derived from the ViT-based encoder with spatial features extracted from the CNN-based encoder. Such integration is realized via multi-scale feature fusion, local and long-distance feature integration, and dense connectivity strategies, leading to a robust feature representation. Finally, the Primary Segmentation-guided Fine Extraction Module (PSFEM) further bolsters the precision of remote sensing image segmentation. Collectively, these two modules constitute our light-weight decoder, with a parameter size of less than 4 M. Our approach is evaluated on two distinct water-body datasets, indicating superiority over other leading segmentation techniques. In addition, our method also demonstrates exemplary efficacy in diverse remote sensing segmentation tasks, such as building extraction and land cover classification. The source codes will be available at https://github.com/zhilyzhang/ESFFNet.

A semantic features-enhanced dispensation network for retrieving remote sensing images

High-Order Semantic Decoupling Network for Remote Sensing Image Semantic Segmentation

A Frequency Domain Feature-Guided Network for Semantic Segmentation of Remote Sensing Images

A Spectral–Spatial Context-Boosted Network for Semantic Segmentation of Remote Sensing Images

SSCNet: A Spectrum-Space Collaborative Network for Semantic Segmentation of Remote Sensing Images

A semantic segmentation method for remote sensing images based on multiple contextual feature extraction

Semantic-Guided Attention Refinement Network for Salient Object Detection in Optical Remote Sensing Images

Semantic segmentation for remote sensing images via dense feature extraction and companion loss neural network

Enhanced semantic-positional feature fusion network via diverse pre-trained encoders for remote sensing image water-body segmentation

Semantic Relation Model and Dataset for Remote Sensing Scene Understanding

A Learnable Joint Spatial and Spectral Transformation for High Resolution Remote Sensing Image Retrieval

Boosting Semantic Segmentation of Remote Sensing Images by Introducing Edge Extraction Network and Spectral Indices

Scale-Semantic Joint Decoupling Network for Image-text Retrieval in Remote Sensing

Semantic Information Feature Aggregation Network for Object Detection in Remote Sensing Images

Deep Learning-Based Technique for Remote Sensing Image Enhancement Using Multiscale Feature Fusion

Global Semantic-Sense Aggregation Network for Salient Object Detection in Remote Sensing Images

Object-Enhanced Semantic Segmentation Model for High-Resolution Remote Sensing Images

A deep learning method for optimizing semantic segmentation accuracy of remote sensing images based on improved UNet

Progressive Complementation Network With Semantics and Details for Salient Object Detection in Optical Remote Sensing Images

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

Full Semantic Constructed Network for Urban Use Classification from Very High-Resolution Optical Remote Sensing Imagery