Abstract:Due to the large intra-class differences between the same categories and the scale imbalance between different categories in the remote sensing image dataset, the semantic segmentation task presents the problem of small-scale object information loss, the imbalance between foreground and background, and simultaneously the background dominates, which seriously affects the performance of the network model. To solve the above problems, this paper proposes an efficient bilateral branch depth neural network model based on the U-Net depth neural network, named BBU-Net. Firstly, one branch of the network learns the distribution characteristics of the original data, and the other focuses on difficult samples. Then the two branches improve the representation and classification ability of the neural network by accumulating learning strategies. Finally, considering the geometric diversity of remote sensing images, this paper adopts test time augmentation and reflection padding strategies and proposes a balanced weighted loss function named CombineLoss to alleviate the imbalance in the training process. The depth neural network proposed in this paper was first tested on the Inria Aerial Image Labeling Dataset, and 87.53% of mean intersection over union and 97.4% of mean pixel accuracy were obtained, respectively. At the same time, to verify the model's complexity, the model proposed in this paper is compared with the neural network based on integrated learning. The comparison results show that the spatial complexity of the network proposed in this paper is much lower than the neural network obtained by integrated learning, and the parameters are also much smaller than the neural network based on integrated learning. Then use the satellite building dataset I in the WHU Building Dataset and mainstream semantic segmentation methods for multiple groups of comparative experiments. The experimental results show that the method proposed in this paper can effectively extract the semantic information of remote sensing images, significantly improve the imbalance of remote sensing image data, improve the performance of the network model, and achieve a good semantic segmentation effect, which fully proves the effectiveness of this method.

Collaborative Learning with a Multi-Branch Framework for Feature Enhancement.

Dual-Branch Feature Fusion Network for Salient Object Detection

Depth Image Super-resolution via Two-Branch Network

ACNET: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation.

Tree-Like Branching Network for Multi-class Classification

Learning Unified Representations for Multi-Resolution Face Recognition

A Dynamic Feature Interaction Framework for Multi-task Visual Perception

Tribranchu-Net: A Size-Sensitive Network for Orbital Tumor Segmentation.

Multi-branch Collaborative Learning Network for 3D Visual Grounding

A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification

Generalizable Two-Branch Framework for Image Class-Incremental Learning

Connectivity Learning in Multi-Branch Networks

Multi-Branch U-Net for Interactive Segmentation

Multi-Branch and Progressive Network for Low-Light Image Enhancement

Semantic segmentation of remote sensing image based on bilateral branch network

Intra-Model Collaborative Learning of Neural Networks.

Multi-depth branch network for efficient image super-resolution

Branch-Cooperative OSNet for Person Re-Identification

Branch-Transformer: A Parallel Branch Architecture to Capture Local and Global Features for Language Identification

MTRBNet: Multi-branch Topology Residual Block-based Network for Low-light Enhancement