Abstract:Deep learning (DL)-based approaches are notable for their ability to establish feature associations without relying on physical constraints, unlike traditional strategies that are complex and dependent on expert experience. However, three main challenges hinder the versatility of semantic segmentation models. First, the targets in these images are dense and exist at varying spatial scales, which imposes higher demands on the model for accurate segmentation across scales. Second, the segmentation of small targets in the images is often overlooked, leading to a compromise between fine segmentation and model efficiency. Lastly, the data-intensive nature of remote sensing images and the resource-intensive operations of large-scale networks impose significant communication and computation burdens on edge devices, which may not have sufficient resources to handle them effectively. To address these challenges, this paper proposes a lightweight semantic segmentation method for remote sensing images to achieve high-precision segmentation for multi-scale targets while maintaining low computational complexity. The main components include: (1) embedding the inverted residual block structure to minimize the number of model parameters and computational costs; (2) introducing the parallel irregular space pyramid pooling module to efficiently aggregate multi-scale contextual information for fine-grained recognition of small targets; and (3) embedding transfer learning into the encoder-decoder structure to speed up the convergence rate and improve multi-scale feature fusion capability, thereby reducing semantic information loss. The proposed lightweight method has been extensively tested on real-world high-resolution remote sensing datasets. It achieved PA, MPA, MIoU, and FWIoU scores of 87.90%, 75.76%, 66.29%, and 78.81% on the Vaihingen dataset; 87.03%, 85.31%, 74.85%, and 77.54% on the Potsdam dataset; and 95.37%, 83.33%, 75.70%, and 91.31% on the Aeroscapes dataset. Compared to other popular semantic segmentation models, the proposed method achieved the highest values in all four evaluation indicators, demonstrating its effectiveness and superiority.

DEUFormer: High‐precision semantic segmentation for urban remote sensing images

An Image Segmentation Method Based on Transformer and Multi-Scale Feature Fusion for UAV Marine Environment Monitoring

UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery

Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net

Semantic segmentation of UAV remote sensing images based on edge feature fusing and multi-level upsampling integrated with Deeplabv3+

UNeXt: An Efficient Network for the Semantic Segmentation of High-Resolution Remote Sensing Images

UAVformer: A Composite Transformer Network for Urban Scene Segmentation of UAV Images

DESformer: A Dual-branch Encoding Strategy for Semantic Segmentation of Very-High-Resolution Remote Sensing Images Based on Feature Interaction and Multi-Scale Context Fusion

Remote Sensing Image Semantic Segmentation Based on Fusion of Transformer and Lightweight Deeplabv3+

DUFormer: Solving Power Line Detection Task in Aerial Images using Semantic Segmentation

EIDU-Net: edge-preserved inception DenseGCN U-Net for LiDAR point cloud segmentation

DEANet: Dual Encoder with Attention Network for Semantic Segmentation of Remote Sensing Imagery

Advancing high-resolution remote sensing: a compact and powerful approach to semantic segmentation

BFANet: Effective Segmentation Network for Low Altitude High-Resolution Urban Scene Image

Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network

Efficient Multi-scale Network for Semantic Segmentation of fine-Resolution Remotely Sensed Images

A Multi-Attention UNet for Semantic Segmentation in Remote Sensing Images

DESENet: a bilateral network with detail-enhanced semantic encoder for real-time semantic segmentation

Multi-scale Feature Extraction and Fusion Net: Research on UAVs Image Semantic Segmentation Technology

Semantic scene segmentation for indoor autonomous vision systems: leveraging an enhanced and efficient U-NET architecture

Multi-Source Remote Sensing Images Semantic Segmentation Based on Differential Feature Attention Fusion