Abstract:Due to the large intra-class differences between the same categories and the scale imbalance between different categories in the remote sensing image dataset, the semantic segmentation task presents the problem of small-scale object information loss, the imbalance between foreground and background, and simultaneously the background dominates, which seriously affects the performance of the network model. To solve the above problems, this paper proposes an efficient bilateral branch depth neural network model based on the U-Net depth neural network, named BBU-Net. Firstly, one branch of the network learns the distribution characteristics of the original data, and the other focuses on difficult samples. Then the two branches improve the representation and classification ability of the neural network by accumulating learning strategies. Finally, considering the geometric diversity of remote sensing images, this paper adopts test time augmentation and reflection padding strategies and proposes a balanced weighted loss function named CombineLoss to alleviate the imbalance in the training process. The depth neural network proposed in this paper was first tested on the Inria Aerial Image Labeling Dataset, and 87.53% of mean intersection over union and 97.4% of mean pixel accuracy were obtained, respectively. At the same time, to verify the model's complexity, the model proposed in this paper is compared with the neural network based on integrated learning. The comparison results show that the spatial complexity of the network proposed in this paper is much lower than the neural network obtained by integrated learning, and the parameters are also much smaller than the neural network based on integrated learning. Then use the satellite building dataset I in the WHU Building Dataset and mainstream semantic segmentation methods for multiple groups of comparative experiments. The experimental results show that the method proposed in this paper can effectively extract the semantic information of remote sensing images, significantly improve the imbalance of remote sensing image data, improve the performance of the network model, and achieve a good semantic segmentation effect, which fully proves the effectiveness of this method.

Multi-Scale Weighted Branch Network for Remote Sensing Image Classification.

Remote Sensing Scene Image Classification Model Based on Multi-Scale Features and Attention Mechanism

A lightweight and stochastic depth residual attention network for remote sensing scene classification

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Weighted multiscale region-level sparse representation for classification of high-spatial resolution remote sensing images

Remote Sensing Scene Classification by Gated Bidirectional Network

Multi-Scale Dense Networks for Hyperspectral Remote Sensing Image Classification

The Classification of Hyperspectral Images: A Double-Branch Multi-Scale Residual Network

Channel-Attention-Based DenseNet Network for Remote Sensing Image Scene Classification

A Lightweight Interlayer Multiscale Dense Network for Classifying Hyperspectral Remote Sensing Images

A Lightweight Dual-Branch Network for Building Change Detection in Remote Sensing Images Integrating Cross-Scale Coupling and Boundary Constraint

Semantic segmentation of remote sensing image based on bilateral branch network

Multiscale and Multidimensional Weighted Network for Salient Object Detection in Optical Remote Sensing Images

Classification of Very-High-Spatial-Resolution Aerial Images Based on Multiscale Features with Limited Semantic Information

Real-Time Dense Semantic Labeling with Dual-Path Framework for High-Resolution Remote Sensing Image

A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification

A multi-scale dense residual correlation network for remote sensing scene classification

A New Dual-Branch Embedded Multivariate Attention Network for Hyperspectral Remote Sensing Classification

A Cross-Channel Dense Connection and Multi-Scale Dual Aggregated Attention Network for Hyperspectral Image Classification

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

Pruning Multi-Scale Multi-Branch Network for Small-Sample Hyperspectral Image Classification