Abstract:Deep learning (DL)-based approaches are notable for their ability to establish feature associations without relying on physical constraints, unlike traditional strategies that are complex and dependent on expert experience. However, three main challenges hinder the versatility of semantic segmentation models. First, the targets in these images are dense and exist at varying spatial scales, which imposes higher demands on the model for accurate segmentation across scales. Second, the segmentation of small targets in the images is often overlooked, leading to a compromise between fine segmentation and model efficiency. Lastly, the data-intensive nature of remote sensing images and the resource-intensive operations of large-scale networks impose significant communication and computation burdens on edge devices, which may not have sufficient resources to handle them effectively. To address these challenges, this paper proposes a lightweight semantic segmentation method for remote sensing images to achieve high-precision segmentation for multi-scale targets while maintaining low computational complexity. The main components include: (1) embedding the inverted residual block structure to minimize the number of model parameters and computational costs; (2) introducing the parallel irregular space pyramid pooling module to efficiently aggregate multi-scale contextual information for fine-grained recognition of small targets; and (3) embedding transfer learning into the encoder-decoder structure to speed up the convergence rate and improve multi-scale feature fusion capability, thereby reducing semantic information loss. The proposed lightweight method has been extensively tested on real-world high-resolution remote sensing datasets. It achieved PA, MPA, MIoU, and FWIoU scores of 87.90%, 75.76%, 66.29%, and 78.81% on the Vaihingen dataset; 87.03%, 85.31%, 74.85%, and 77.54% on the Potsdam dataset; and 95.37%, 83.33%, 75.70%, and 91.31% on the Aeroscapes dataset. Compared to other popular semantic segmentation models, the proposed method achieved the highest values in all four evaluation indicators, demonstrating its effectiveness and superiority.

An Empirical Study on Multi-domain Robust Semantic Segmentation

In Defense Of Multi-Source Omni-Supervised Efficient Convnet For Robust Semantic Segmentation In Heterogeneous Unseen Domains

MSeg: A Composite Dataset for Multi-domain Semantic Segmentation

A Study of RobustNet, a Domain Generalization Method for Semantic Segmentation

Resolving Inconsistent Semantics in Multi-Dataset Image Segmentation

Scaling up Multi-domain Semantic Segmentation with Sentence Embeddings

Multi-domain semantic segmentation with pyramidal fusion

DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Model

March on Data Imperfections: Domain Division and Domain Generalization for Semantic Segmentation.

Towards Reliable Evaluation and Fast Training of Robust Semantic Segmentation Models

Robust 3D Semantic Segmentation Method Based on Multi-Modal Collaborative Learning

Advancing high-resolution remote sensing: a compact and powerful approach to semantic segmentation

MultiSenseSeg: A Cost-Effective Unified Multimodal Semantic Segmentation Model for Remote Sensing

Multi-dataset Pretraining: A Unified Model for Semantic Segmentation

DILRS: Domain-Incremental Learning for Semantic Segmentation in Multi-Source Remote Sensing Data

Weakly Supervised Training of Universal Visual Concepts for Multi-domain Semantic Segmentation

Automated Label Unification for Multi-Dataset Semantic Segmentation with GNNs

Robust Weakly Supervised Semantic Segmentation Via Dual Domain Cascaded Decision and Annotation Bootstrap

Unsupervised cross domain semantic segmentation with mutual refinement and information distillation

Learning to Generate Training Datasets for Robust Semantic Segmentation

A dual-channel network for cross-domain one-shot semantic segmentation via adversarial learning