Abstract:In the era of increasingly advanced Earth Observation (EO) technologies, extracting pertinent information (such as water-bodies) from the Earth's surface has become a crucial task. Deep Learning, especially via pre-trained models, currently offers a highly promising approach for the semantic segmentation of Remote Sensing Imagery (RSI). However, effectively adapting these pre-trained models to RSI tasks remains challenging. Typically, these models undergo fine-tuning for specialized tasks, involving modifications to their parameters or structure of the original architecture, which may impact their inherent generalization capabilities. Furthermore, robust pre-trained models on nature images are not specifically designed for RSI, presenting challenges in their direct application to RSI tasks. To alleviate these problems, our study introduces a light-weight Enhanced Semantic-positional Feature Fusion Network (ESFFNet), leveraging diverse pre-trained image encoders alongside extensive EO data. The proposed method begins by leveraging pre-trained encoders, specifically Vision Transformer (ViT)-based and Convolutional Neural Network (CNN)-based models, to extract deep semantic and precise positional features respectively, without additional training. Following this, we introduce the Enhanced Semantic-positional Feature Fusion Module (ESFFM). This module adeptly merges semantic features derived from the ViT-based encoder with spatial features extracted from the CNN-based encoder. Such integration is realized via multi-scale feature fusion, local and long-distance feature integration, and dense connectivity strategies, leading to a robust feature representation. Finally, the Primary Segmentation-guided Fine Extraction Module (PSFEM) further bolsters the precision of remote sensing image segmentation. Collectively, these two modules constitute our light-weight decoder, with a parameter size of less than 4 M. Our approach is evaluated on two distinct water-body datasets, indicating superiority over other leading segmentation techniques. In addition, our method also demonstrates exemplary efficacy in diverse remote sensing segmentation tasks, such as building extraction and land cover classification. The source codes will be available at https://github.com/zhilyzhang/ESFFNet.

ICENETv2: A Fine-Grained River Ice Semantic Segmentation Network Based on UAV Images

CSEU-Net: ConvNeXt-SE-U-Net for river ice floe segmentation using unmanned aerial vehicle grayscale remote sensing images

Real-time Water Area Segmentation for USV using Enhanced U-Net

Research on semantic segmentation algorithm of high latitude urban river ice based on deep transfer learning

Panoptic Segmentation for Seasonal River Scene Based on Spatial Context Prior and DenseASPP

A Multi-Task Network with Dynamic Segmentation for Sea Ice Classification in Arctic Shipping Route Optimization

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Fine-Scale Sea Ice Segmentation for High-Resolution Satellite Imagery with Weakly-Supervised CNNs

Aerial-BiSeNet: A real-time semantic segmentation network for high resolution aerial imagery

DF-UHRNet: A Modified CNN-Based Deep Learning Method for Automatic Sea Ice Classification from Sentinel-1A/B SAR Images

Multi-scale Feature Extraction and Fusion Net: Research on UAVs Image Semantic Segmentation Technology

An Automated System to Monitor River Ice Conditions Using Visible Infrared Imaging Radiometer Suite Imagery

Efficient Multi-scale Network for Semantic Segmentation of fine-Resolution Remotely Sensed Images

RSI-Net: Two-Stream Deep Neural Network for Remote Sensing Images-Based Semantic Segmentation

EDWNet: A Novel Encoder–Decoder Architecture Network for Water Body Extraction from Optical Images

Precise and Fast Segmentation of Sea Ice in High-Resolution Images Based on Multiscale and Knowledge Distillation

Enhanced semantic-positional feature fusion network via diverse pre-trained encoders for remote sensing image water-body segmentation

Edge-Enhanced GCIFFNet: A Multiclass Semantic Segmentation Network Based on Edge Enhancement and Multiscale Attention Mechanism

Crop Segmentation of Unmanned Aerial Vehicle Imagery Using Edge Enhancement Network

Breaking The Ice: Video Segmentation for Close-Range Ice-Covered Waters

CREVNet: A Transformer and CNN-Based Network for Accurate Segmentation of Ice Shelf Crevasses