Abstract:Benefiting from the powerful feature extraction and feature correlation modeling capabilities of convolutional neural networks (CNNs) and Transformer models, these techniques have been widely used in unmanned aerial vehicle (UAV) aerial image semantic segmentation tasks. However, the ground objects in aerial images contain feature information with different scales, and existing methods directly cascade low-level visual features and high-level semantic features without processing, resulting in low semantic segmentation precision. To address these challenges, we propose a Dual-Encoder Cross-Scale Attention Network, which efficiently extracts local and global context information from aerial images and performs fine-grained fusion of multi-scale features to improve semantic segmentation performance. Firstly, we introduce the Dual-CNNs-Transformer Encoder, which embeds the Scan-Focus Window Transformer (SFWT) into CNNs as an auxiliary encoder to supplement the local feature information lost in the global context information extraction process. Secondly, the Cross-Scale Lightweight Integration (CSLI) module is designed, which uses Light Dot-Product Attention Mechanism (DPAM) to fusion multi-scale features and reduce model calculation parameters. Lastly, the Linear Multi-Layer Perceptron (LMLP) is used to restore the feature map resolution while expanding the deconvolution receptive field. To validate the effectiveness of the proposed method, we conducted extensive experiments on real aerial scene datasets, including UAVid, Urban Drone, and Aeroscapes. The experimental results show that our method achieves state-of-the-art performance while maintaining superior real-time efficiency. Implementation codes will be available on https://github.com/darkseid-arch/UAVSeg.

Semantic segmentation network of uav image based on improved U-net

Real-time Water Area Segmentation for USV using Enhanced U-Net

Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net

A Semantic Segmentation Method Based on Improved U-net Network

Semantic Segmentation of High-Resolution Remote Sensing Images with Improved U-Net Based on Transfer Learning

Deep semantic segmentation of unmanned aerial vehicle remote sensing images based on fully convolutional neural network

U-Net Based Semantic Segmentation Method for High Resolution Remote Sensing Image

Semantic segmentation of urban street scene images based on improved U-Net network

Multi-scale Feature Extraction and Fusion Net: Research on UAVs Image Semantic Segmentation Technology

SEMANTIC SEGMENTATION OF UAV IMAGES BASED ON U-NET IN URBAN AREA

Image Semantic Segmentation Method Based on Deep Learning in UAV Aerial Remote Sensing Image

An improved U-Net method for the semantic segmentation of remote sensing images

UAVSeg: Dual-Encoder Cross-Scale Attention Network for UAV Images Semantic Segmentation

An Aerial Image Segmentation Approach Based on Enhanced Multi-Scale Convolutional Neural Network

Image Semantic Segmentation Method with Fusion of Transposed Convolution and Deep Residual

Improved U-NET Semantic Segmentation Network

Boundary refinement network with semantic embedding connections for UAV aerial image semantic segmentation

Semantic segmentation of oblique UAV video based on ConvLSTM in complex urban area

Sea and Land Segmentation of Optical Remote Sensing Images Based on U-Net Optimization

Research on Improved U-net Based Remote Sensing Image Segmentation Algorithm

Semantic Segmentation of Aerial Image Using Fully Convolutional Network.