Abstract:Due to the large intra-class differences between the same categories and the scale imbalance between different categories in the remote sensing image dataset, the semantic segmentation task presents the problem of small-scale object information loss, the imbalance between foreground and background, and simultaneously the background dominates, which seriously affects the performance of the network model. To solve the above problems, this paper proposes an efficient bilateral branch depth neural network model based on the U-Net depth neural network, named BBU-Net. Firstly, one branch of the network learns the distribution characteristics of the original data, and the other focuses on difficult samples. Then the two branches improve the representation and classification ability of the neural network by accumulating learning strategies. Finally, considering the geometric diversity of remote sensing images, this paper adopts test time augmentation and reflection padding strategies and proposes a balanced weighted loss function named CombineLoss to alleviate the imbalance in the training process. The depth neural network proposed in this paper was first tested on the Inria Aerial Image Labeling Dataset, and 87.53% of mean intersection over union and 97.4% of mean pixel accuracy were obtained, respectively. At the same time, to verify the model's complexity, the model proposed in this paper is compared with the neural network based on integrated learning. The comparison results show that the spatial complexity of the network proposed in this paper is much lower than the neural network obtained by integrated learning, and the parameters are also much smaller than the neural network based on integrated learning. Then use the satellite building dataset I in the WHU Building Dataset and mainstream semantic segmentation methods for multiple groups of comparative experiments. The experimental results show that the method proposed in this paper can effectively extract the semantic information of remote sensing images, significantly improve the imbalance of remote sensing image data, improve the performance of the network model, and achieve a good semantic segmentation effect, which fully proves the effectiveness of this method.

BFANet: Effective Segmentation Network for Low Altitude High-Resolution Urban Scene Image

An Image Segmentation Method Based on Transformer and Multi-Scale Feature Fusion for UAV Marine Environment Monitoring

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Multi-scale Feature Extraction and Fusion Net: Research on UAVs Image Semantic Segmentation Technology

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images

BAFNet: Bilateral Attention Fusion Network for Lightweight Semantic Segmentation of Urban Remote Sensing Images

Aerial-BiSeNet: A real-time semantic segmentation network for high resolution aerial imagery

FBSNet: A Fast Bilateral Symmetrical Network for Real-Time Semantic Segmentation

Semantic segmentation of remote sensing image based on bilateral branch network

Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenes

DARSegNet: A Real-Time Semantic Segmentation Method Based on Dual Attention Fusion Module and Encoder-Decoder Network

FBRNet: a feature fusion and border refinement network for real-time semantic segmentation

Semantic segmentation of oblique UAV video based on ConvLSTM in complex urban area

SEMANTIC SEGMENTATION OF UAV IMAGES BASED ON U-NET IN URBAN AREA

Attention-Guided Multi-Scale Fusion Network for Similar Objects Semantic Segmentation

A Boundary Guided Cross Fusion Approach for Remote Sensing Image Segmentation

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

Dual-Branch Dynamic Object Segmentation Network Based on Spatio-Temporal Information Fusion

Memory-Constrained Semantic Segmentation for Ultra-High Resolution UAV Imagery

AF$_2$: Adaptive Focus Framework for Aerial Imagery Segmentation

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery