Abstract:Deep learning (DL)-based approaches are notable for their ability to establish feature associations without relying on physical constraints, unlike traditional strategies that are complex and dependent on expert experience. However, three main challenges hinder the versatility of semantic segmentation models. First, the targets in these images are dense and exist at varying spatial scales, which imposes higher demands on the model for accurate segmentation across scales. Second, the segmentation of small targets in the images is often overlooked, leading to a compromise between fine segmentation and model efficiency. Lastly, the data-intensive nature of remote sensing images and the resource-intensive operations of large-scale networks impose significant communication and computation burdens on edge devices, which may not have sufficient resources to handle them effectively. To address these challenges, this paper proposes a lightweight semantic segmentation method for remote sensing images to achieve high-precision segmentation for multi-scale targets while maintaining low computational complexity. The main components include: (1) embedding the inverted residual block structure to minimize the number of model parameters and computational costs; (2) introducing the parallel irregular space pyramid pooling module to efficiently aggregate multi-scale contextual information for fine-grained recognition of small targets; and (3) embedding transfer learning into the encoder-decoder structure to speed up the convergence rate and improve multi-scale feature fusion capability, thereby reducing semantic information loss. The proposed lightweight method has been extensively tested on real-world high-resolution remote sensing datasets. It achieved PA, MPA, MIoU, and FWIoU scores of 87.90%, 75.76%, 66.29%, and 78.81% on the Vaihingen dataset; 87.03%, 85.31%, 74.85%, and 77.54% on the Potsdam dataset; and 95.37%, 83.33%, 75.70%, and 91.31% on the Aeroscapes dataset. Compared to other popular semantic segmentation models, the proposed method achieved the highest values in all four evaluation indicators, demonstrating its effectiveness and superiority.

Multi-modal remote sensing image segmentation based on attention-driven dual-branch encoding framework

Semantic segmentation of remote sensing images based on dual‐channel attention mechanism

Remote sensing image semantic segmentation via class-guided structural interaction and boundary perception

A semantic segmentation method for remote sensing images based on multiple contextual feature extraction

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

DHRNet: A Dual-Branch Hybrid Reinforcement Network for Semantic Segmentation of Remote Sensing Images

DOCNet: Dual-Domain Optimized Class-Aware Network for Remote Sensing Image Segmentation

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images

A Dual-Branch Deep Learning Architecture for Multisensor and Multitemporal Remote Sensing Semantic Segmentation

Semantic Segmentation With Attention Mechanism for Remote Sensing Images

Elevation Information-Guided Multimodal Fusion Robust Framework for Remote Sensing Image Segmentation

A Cyclic Information–Interaction Model for Remote Sensing Image Segmentation

Dual-Path Geometry-Aware Network for Semantic Segmentation of High-Resolution Aerial Images

Advancing high-resolution remote sensing: a compact and powerful approach to semantic segmentation

Multi-scale attention fusion network for semantic segmentation of remote sensing images

XANet: An Efficient Remote Sensing Image Segmentation Model Using Element-Wise Attention Enhancement and Multi-Scale Attention Fusion

DESformer: A Dual-branch Encoding Strategy for Semantic Segmentation of Very-High-Resolution Remote Sensing Images Based on Feature Interaction and Multi-Scale Context Fusion

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

Dual-Domain Fusion Network Based on Wavelet Frequency Decomposition and Fuzzy Spatial Constraint for Remote Sensing Image Segmentation

Hierarchical Self-Attention Embedded Neural Network With Dense Connection for Remote-Sensing Image Semantic Segmentation

Dual attention deep fusion semantic segmentation networks of large-scale satellite remote-sensing images