Abstract:Deep learning (DL)-based approaches are notable for their ability to establish feature associations without relying on physical constraints, unlike traditional strategies that are complex and dependent on expert experience. However, three main challenges hinder the versatility of semantic segmentation models. First, the targets in these images are dense and exist at varying spatial scales, which imposes higher demands on the model for accurate segmentation across scales. Second, the segmentation of small targets in the images is often overlooked, leading to a compromise between fine segmentation and model efficiency. Lastly, the data-intensive nature of remote sensing images and the resource-intensive operations of large-scale networks impose significant communication and computation burdens on edge devices, which may not have sufficient resources to handle them effectively. To address these challenges, this paper proposes a lightweight semantic segmentation method for remote sensing images to achieve high-precision segmentation for multi-scale targets while maintaining low computational complexity. The main components include: (1) embedding the inverted residual block structure to minimize the number of model parameters and computational costs; (2) introducing the parallel irregular space pyramid pooling module to efficiently aggregate multi-scale contextual information for fine-grained recognition of small targets; and (3) embedding transfer learning into the encoder-decoder structure to speed up the convergence rate and improve multi-scale feature fusion capability, thereby reducing semantic information loss. The proposed lightweight method has been extensively tested on real-world high-resolution remote sensing datasets. It achieved PA, MPA, MIoU, and FWIoU scores of 87.90%, 75.76%, 66.29%, and 78.81% on the Vaihingen dataset; 87.03%, 85.31%, 74.85%, and 77.54% on the Potsdam dataset; and 95.37%, 83.33%, 75.70%, and 91.31% on the Aeroscapes dataset. Compared to other popular semantic segmentation models, the proposed method achieved the highest values in all four evaluation indicators, demonstrating its effectiveness and superiority.

Boosting Semantic Segmentation of Aerial Images Via Decoupled and Multilevel Compaction and Dispersion

Advancing high-resolution remote sensing: a compact and powerful approach to semantic segmentation

Multiscale Prototype Contrast Network for High-Resolution Aerial Imagery Semantic Segmentation

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

PointBoost: LiDAR-Enhanced Semantic Segmentation of Remote Sensing Imagery

Double Similarity Distillation for Semantic Image Segmentation

AF$_2$: Adaptive Focus Framework for Aerial Imagery Segmentation

AF2: Adaptive Focus Framework for Aerial Imagery Segmentation

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images

Semantic Segmentation of Very-High-Resolution Remote Sensing Images via Deep Multi-Feature Learning

Robust 3D Semantic Segmentation Method Based on Multi-Modal Collaborative Learning

Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images

Decoupling semantic and localization for semantic segmentation via magnitude-aware and phase-sensitive learning

Scale-Aware Detailed Matching for Few-Shot Aerial Image Semantic Segmentation

A Deep Semantic Segmentation Network with Semantic and Contextual Refinements

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

Multispectral Semantic Land Cover Segmentation From Aerial Imagery With Deep Encoder–Decoder Network

Edge-guided and Class-balanced Active Learning for Semantic Segmentation of Aerial Images

Multispectral LiDAR Point Cloud Segmentation for Land Cover Leveraging Semantic Fusion in Deep Learning Network

Semantic Segmentation of Aerial Laser Point Clouds Based on Deep-Residual Enhanced Coding of Multi-Feature Information

Confidence-Weighted Dual-Teacher Networks With Biased Contrastive Learning for Semi-Supervised Semantic Segmentation in Remote Sensing Images