Abstract:Due to the large intra-class differences between the same categories and the scale imbalance between different categories in the remote sensing image dataset, the semantic segmentation task presents the problem of small-scale object information loss, the imbalance between foreground and background, and simultaneously the background dominates, which seriously affects the performance of the network model. To solve the above problems, this paper proposes an efficient bilateral branch depth neural network model based on the U-Net depth neural network, named BBU-Net. Firstly, one branch of the network learns the distribution characteristics of the original data, and the other focuses on difficult samples. Then the two branches improve the representation and classification ability of the neural network by accumulating learning strategies. Finally, considering the geometric diversity of remote sensing images, this paper adopts test time augmentation and reflection padding strategies and proposes a balanced weighted loss function named CombineLoss to alleviate the imbalance in the training process. The depth neural network proposed in this paper was first tested on the Inria Aerial Image Labeling Dataset, and 87.53% of mean intersection over union and 97.4% of mean pixel accuracy were obtained, respectively. At the same time, to verify the model's complexity, the model proposed in this paper is compared with the neural network based on integrated learning. The comparison results show that the spatial complexity of the network proposed in this paper is much lower than the neural network obtained by integrated learning, and the parameters are also much smaller than the neural network based on integrated learning. Then use the satellite building dataset I in the WHU Building Dataset and mainstream semantic segmentation methods for multiple groups of comparative experiments. The experimental results show that the method proposed in this paper can effectively extract the semantic information of remote sensing images, significantly improve the imbalance of remote sensing image data, improve the performance of the network model, and achieve a good semantic segmentation effect, which fully proves the effectiveness of this method.

Multi-branch residual image semantic segmentation combined with inverse weight gated-control

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Real-time Water Area Segmentation for USV using Enhanced U-Net

Semantic segmentation of remote sensing image based on bilateral branch network

CTMU-Net: an Improved U-Net for Semantic Segmentation of Remote-Sensing Images Based on the Combined Attention Mechanism

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

Multi-U-Net: Residual Module under Multisensory Field and Attention Mechanism Based Optimized U-Net for VHR Image Semantic Segmentation

Multi-resolution Cascaded Network with Depth-similar Residual Module for Real-time Semantic Segmentation on RGB-D Images.

General Image Segmentation by Deeper Residual U-Net

MDNet: A Multi-image Input Real-Time Semantic Segmentation Model with Decoupled Supervision

Bilateral Network with Residual U-blocks and Dual-Guided Attention for Real-time Semantic Segmentation

A lightweight underwater fish image semantic segmentation model based on U‐Net

Multi-scale attention fusion network for semantic segmentation of remote sensing images

Integrating Gate and Attention Modules for High-Resolution Image Semantic Segmentation

Boundary-Guided Lightweight Semantic Segmentation With Multi-Scale Semantic Context

Research on Improved U-net Based Remote Sensing Image Segmentation Algorithm

IMM-Net: Integrated Multi-stream Memory Network for Real-Time Semantic Segmentation

BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic Segmentation

CM-Unet: A Novel Remote Sensing Image Segmentation Method Based on Improved U-Net

Aerial-BiSeNet: A real-time semantic segmentation network for high resolution aerial imagery

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images