Abstract:There are still various challenges in remote sensing semantic segmentation due to objects diversity and complexity. Transformer-based models have significant advantages in capturing global feature dependencies for segmentation. However, it unfortunately ignores local feature details. On the other hand, convolutional neural network (CNN), with a different interaction mechanism from transformer-based models, captures more small-scale local features instead of global features. In this article, a new semantic segmentation net framework named SSNet is proposed, which incorporates an encoder–decoder structure, optimizing the advantages of both local and global features. In addition, we build feature fuse module and feature inject module to largely fuse these two-style features. The former module captures the dependencies between different positions and channels to extract multiscale features, which promotes the segmentation precision on similar objects. The latter module condenses the global information in transformer and injects it into CNN to obtain a broad global field of view, in which the depthwise strip convolution improves the segmentation accuracy on tiny objects. A CNN-based decoder progressively recovers the feature map size, and a block called atrous spatial pyramid pooling is adopted in decoder to obtain a multiscale context. The skip connection is established between the decoder and the encoder, which retains important feature information of the shallow layer network and is conducive to achieving flow of multiscale features. To evaluate our model, we compare it with current state-of-the-art models on WHDLD and Potsdam datasets. The experimental results indicate that our proposed model achieves more precise semantic segmentation.

Tree-Structured Kronecker Convolutional Network for Semantic Segmentation

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

TreeUNet: Adaptive Tree Convolutional Neural Networks for Subdecimeter Aerial Image Segmentation

Three-branch Semantic Segmentation Network

Cross Aggregation Network for Semantic Segmentation

TCNet: Multiscale Fusion of Transformer and CNN for Semantic Segmentation of Remote Sensing Images

Cascaded Multiscale Structure with Self-Smoothing Atrous Convolution for Semantic Segmentation

Hybrid Dilated Convolution Network Using Attentive Kernels for Real-Time Semantic Segmentation

See more than once: Kernel-sharing atrous convolution for semantic segmentation

TreeSegNet: Adaptive Tree CNNs for Subdecimeter Aerial Image Segmentation

Fully Convolutional Pyramidal Networks for Semantic Segmentation.

Multi‐stream Densely Connected Network for Semantic Segmentation

SSNet: A Novel Transformer and CNN Hybrid Network for Remote Sensing Semantic Segmentation

CTCFNet: CNN-Transformer Complementary and Fusion Network for High-Resolution Remote Sensing Image Semantic Segmentation

CoT: Contourlet Transformer for Hierarchical Semantic Segmentation

Semantic Segmentation Network with Multi-Path Structure, Attention Reweighting and Multi-Scale Encoding

Image semantic segmentation based on FCN-CRF model

FastFCN: Rethinking Dilated Convolution in the Backbone for Semantic Segmentation

Fully Convolutional Networks for Semantic Segmentation

A Top-Down Manner-Based DCNN Architecture for Semantic Image Segmentation.

Multi-Receptive Atrous Convolutional Network for Semantic Segmentation.