Abstract:In the era of increasingly advanced Earth Observation (EO) technologies, extracting pertinent information (such as water-bodies) from the Earth's surface has become a crucial task. Deep Learning, especially via pre-trained models, currently offers a highly promising approach for the semantic segmentation of Remote Sensing Imagery (RSI). However, effectively adapting these pre-trained models to RSI tasks remains challenging. Typically, these models undergo fine-tuning for specialized tasks, involving modifications to their parameters or structure of the original architecture, which may impact their inherent generalization capabilities. Furthermore, robust pre-trained models on nature images are not specifically designed for RSI, presenting challenges in their direct application to RSI tasks. To alleviate these problems, our study introduces a light-weight Enhanced Semantic-positional Feature Fusion Network (ESFFNet), leveraging diverse pre-trained image encoders alongside extensive EO data. The proposed method begins by leveraging pre-trained encoders, specifically Vision Transformer (ViT)-based and Convolutional Neural Network (CNN)-based models, to extract deep semantic and precise positional features respectively, without additional training. Following this, we introduce the Enhanced Semantic-positional Feature Fusion Module (ESFFM). This module adeptly merges semantic features derived from the ViT-based encoder with spatial features extracted from the CNN-based encoder. Such integration is realized via multi-scale feature fusion, local and long-distance feature integration, and dense connectivity strategies, leading to a robust feature representation. Finally, the Primary Segmentation-guided Fine Extraction Module (PSFEM) further bolsters the precision of remote sensing image segmentation. Collectively, these two modules constitute our light-weight decoder, with a parameter size of less than 4 M. Our approach is evaluated on two distinct water-body datasets, indicating superiority over other leading segmentation techniques. In addition, our method also demonstrates exemplary efficacy in diverse remote sensing segmentation tasks, such as building extraction and land cover classification. The source codes will be available at https://github.com/zhilyzhang/ESFFNet.

Difference-Focusing Fusion Decision Method: An Ensemble Learning Framework and Its Application in Improving Deep Learning Sea–Land Segmentation for Waterline Extraction in Synthetic Aperture Radar Imagery

An Image Segmentation Method Based on Transformer and Multi-Scale Feature Fusion for UAV Marine Environment Monitoring

Enhanced semantic-positional feature fusion network via diverse pre-trained encoders for remote sensing image water-body segmentation

Water Stream Extraction via Feature-Fused Encoder-Decoder Network Based on SAR Images

Water-body detection from synthetic aperture radar images using dual-branch fusion network

DESformer: A Dual-branch Encoding Strategy for Semantic Segmentation of Very-High-Resolution Remote Sensing Images Based on Feature Interaction and Multi-Scale Context Fusion

Local Feature Search Network for Building and Water Segmentation of Remote Sensing Image

MSAFNet: Multiscale Successive Attention Fusion Network for Water Body Extraction of Remote Sensing Images

A Deep Feature Fusion Method for Complex Ground Object Classification in the Land Cover Ecosystem Using ZY1-02D and Sentinel-1A

Segmentation of Low Scattering Region in SAR Images Using Multi-Module Fusion Network

DeepMerge: Deep-Learning-Based Region-Merging for Image Segmentation

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Extraction of water bodies from high-resolution remote sensing imagery based on a deep semantic segmentation network

A novel sea-land segmentation network for enhanced coastline extraction using satellite remote sensing images

SRMA: a dual-branch parallel multi-scale attention network for remote sensing images sea-land segmentation

Collision-Free Waterway Segmentation for Inland Unmanned Surface Vehicles

Multiscale Refinement Network for Water-Body Segmentation in High-Resolution Satellite Imagery

Underwater sonar image segmentation combining pixel-level and region-level information

A Network for Merging SAR Image Sea-Land Segmentation and Coastline Detection Tasks

An Approach for Integrating SAR Imagery in Sea-Land Segmentation and Coastline Detection

Combining Segmentation Network and Nonsubsampled Contourlet Transform for Automatic Marine Raft Aquaculture Area Extraction from Sentinel-1 Images