Abstract:Due to the large intra-class differences between the same categories and the scale imbalance between different categories in the remote sensing image dataset, the semantic segmentation task presents the problem of small-scale object information loss, the imbalance between foreground and background, and simultaneously the background dominates, which seriously affects the performance of the network model. To solve the above problems, this paper proposes an efficient bilateral branch depth neural network model based on the U-Net depth neural network, named BBU-Net. Firstly, one branch of the network learns the distribution characteristics of the original data, and the other focuses on difficult samples. Then the two branches improve the representation and classification ability of the neural network by accumulating learning strategies. Finally, considering the geometric diversity of remote sensing images, this paper adopts test time augmentation and reflection padding strategies and proposes a balanced weighted loss function named CombineLoss to alleviate the imbalance in the training process. The depth neural network proposed in this paper was first tested on the Inria Aerial Image Labeling Dataset, and 87.53% of mean intersection over union and 97.4% of mean pixel accuracy were obtained, respectively. At the same time, to verify the model's complexity, the model proposed in this paper is compared with the neural network based on integrated learning. The comparison results show that the spatial complexity of the network proposed in this paper is much lower than the neural network obtained by integrated learning, and the parameters are also much smaller than the neural network based on integrated learning. Then use the satellite building dataset I in the WHU Building Dataset and mainstream semantic segmentation methods for multiple groups of comparative experiments. The experimental results show that the method proposed in this paper can effectively extract the semantic information of remote sensing images, significantly improve the imbalance of remote sensing image data, improve the performance of the network model, and achieve a good semantic segmentation effect, which fully proves the effectiveness of this method.

Embedded Self-Distillation in Compact Multibranch Ensemble Network for Remote Sensing Scene Classification

Embedded Self-Distillation in Compact Multi-Branch Ensemble Network for Remote Sensing Scene Classification

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Attention-Aware Deep Feature Embedding for Remote Sensing Image Scene Classification

Remote Sensing Scene Classification by Gated Bidirectional Network

SEMSDNet: A Multiscale Dense Network with Attention for Remote Sensing Scene Classification

Remote Sensing Image Scene Classification Based on Deep Multi-branch Feature Fusion Network

Remote Sensing Scene Classification Based on Multibranch Fusion Attention Network

Learn by Yourself: A Feature-Augmented Self-Distillation Convolutional Neural Network for Remote Sensing Scene Image Classification

Remote Sensing Scene Classification Using Sparse Representation-Based Framework with Deep Feature Fusion

Variational Self-Distillation for Remote Sensing Scene Classification

A Remote-Sensing Scene-Image Classification Method Based on Deep Multiple-Instance Learning with a Residual Dense Attention ConvNet

Enhanced Feature Pyramid Network with Deep Semantic Embedding for Remote Sensing Scene Classification

Lightweight Channel Attention and Multiscale Feature Fusion Discrimination for Remote Sensing Scene Classification

Scene Classification Of Remotely Sensed Images Via Densely Connected Convolutional Neural Networks And An Ensemble Classifier

Remote Sensing Scene Classification Via Multi-Branch Local Attention Network.

A Lightweight and Multiscale Network for Remote Sensing Image Scene Classification

Ensemble Model with Cascade Attention Mechanism for High-Resolution Remote Sensing Image Scene Classification

A Multiscale Attention Network for Remote Sensing Scene Images Classification

Enhanced Multihead Self-Attention Block Network for Remote Sensing Image Scene Classification

Semantic segmentation of remote sensing image based on bilateral branch network