Abstract:Deep learning (DL)-based approaches are notable for their ability to establish feature associations without relying on physical constraints, unlike traditional strategies that are complex and dependent on expert experience. However, three main challenges hinder the versatility of semantic segmentation models. First, the targets in these images are dense and exist at varying spatial scales, which imposes higher demands on the model for accurate segmentation across scales. Second, the segmentation of small targets in the images is often overlooked, leading to a compromise between fine segmentation and model efficiency. Lastly, the data-intensive nature of remote sensing images and the resource-intensive operations of large-scale networks impose significant communication and computation burdens on edge devices, which may not have sufficient resources to handle them effectively. To address these challenges, this paper proposes a lightweight semantic segmentation method for remote sensing images to achieve high-precision segmentation for multi-scale targets while maintaining low computational complexity. The main components include: (1) embedding the inverted residual block structure to minimize the number of model parameters and computational costs; (2) introducing the parallel irregular space pyramid pooling module to efficiently aggregate multi-scale contextual information for fine-grained recognition of small targets; and (3) embedding transfer learning into the encoder-decoder structure to speed up the convergence rate and improve multi-scale feature fusion capability, thereby reducing semantic information loss. The proposed lightweight method has been extensively tested on real-world high-resolution remote sensing datasets. It achieved PA, MPA, MIoU, and FWIoU scores of 87.90%, 75.76%, 66.29%, and 78.81% on the Vaihingen dataset; 87.03%, 85.31%, 74.85%, and 77.54% on the Potsdam dataset; and 95.37%, 83.33%, 75.70%, and 91.31% on the Aeroscapes dataset. Compared to other popular semantic segmentation models, the proposed method achieved the highest values in all four evaluation indicators, demonstrating its effectiveness and superiority.

A new real-time image semantic segmentation framework based on a lightweight deep convolutional encoder-decoder architecture for robotic environment sensing

Real-time Semantic Segmentation with Weighted Factorized-Depthwise Convolution

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

High-Resolution Remote Sensing Image Semantic Segmentation Method Based on Improved Encoder-Decoder Convolutional Neural Network

Spatial-information Guided Adaptive Context-aware Network for Efficient RGB-D Semantic Segmentation

Real-time Semantic Segmentation in Traffic Scene Using Cross Stage Partial-based Encoder–decoder Network

Towards Robotic Semantic Segmentation of Supporting Surfaces

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Semantic Reconstruction based on RGB Image and Sparse Depth

Advancing high-resolution remote sensing: a compact and powerful approach to semantic segmentation

AMCFNet: Asymmetric multiscale and crossmodal fusion network for RGB-D semantic segmentation in indoor service robots

Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes

Fast Semantic Segmentation for Scene Perception

A Lightweight Network with Attention Decoder for Real-Time Semantic Segmentation

A real-time semantic segmentation model using iteratively shared features in multiple sub-encoders

DARSegNet: A Real-Time Semantic Segmentation Method Based on Dual Attention Fusion Module and Encoder-Decoder Network

RGB-D Image Semantic Segmentation Based on Multi-Modal Adaptive Convolution

Self-Learned Feature Reconstruction and Offset-Dilated Feature Fusion for Real-Time Semantic Segmentation

A lightweight multi-dimension dynamic convolutional network for real-time semantic segmentation

LightSeg: a Light-Weight Network for Real-Time Semantic Segmentation

A Deep Semantic Segmentation Network with Semantic and Contextual Refinements