Abstract:Low-order features based on convolution kernel are easy to be distorted when encountering dramatic view angle transformation and atmospheric scattering in remote sensing (RS) images. To address this concern, this article first proposes to operate semantic segmentation of RS images based on the high-order information, which can represent the relative relationship of low-order features and is robust and stable when suffering feature distortion. Besides, semantic decouples have recently been well researched and have achieved significant improvement in image understanding. Thus, in this article, a high-order semantic decoupling network (HSDN) is proposed to disentangle features by semantics based on high-order features. Specifically, HSDN first represents each pixel by calculating the pixel-level affinity as a high-order feature and then clusters these pixels into different semantics. Afterward, an attention-like mask generation module is designed for both intra-semantic and inter-semantic groups, leading to three kinds of masks, including the semantic decoupling mask (SDM), which utilizes each high-order cluster centroid as a mask to compact features intracluster and expand different interclusters, so as to improve semantic disentangle performance to a better extent; semantic enhancement mask (SEM), which records pixel-level relative correlation within a class to sufficiently exploit high-order features and could enhance feature robustness; and boundary supplementary mask (BSM), which aims to process borderline pixels to reduce cluster errors. Finally, by applying masks on pixels both within classes and on borderlines, semantic decoupled features are generated and concatenated to realize segmentation. The quantitative and qualitative experiments are conducted on two large-scale fine-resolution RS image datasets to demonstrate the significant performance of adopting high-order representation. Besides, we also implement numerous experiments to va- idate the effectiveness of the proposed semantic decouple framework in dealing with complicated and distortion-prone RS image segmentation tasks.

High-order paired-ASPP for deep semantic segmentation networks

GASP: A New Feature Fusion Module Based on ASPP

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

PSSD-Transformer: Powerful Sparse Spike-Driven Transformer for Image Semantic Segmentation

DPNet: Dual-Pyramid Semantic Segmentation Network Based on Improved Deeplabv3 Plus

PPNet : Pooling Position Attention Network for Semantic Segmentation

ELKPPNet: An Edge-aware Neural Network with Large Kernel Pyramid Pooling for Learning Discriminative Features in Semantic Segmentation

Semantic Segmentation Network Based on Adaptive Attention and Deep Fusion Utilizing a Multi-Scale Dilated Convolutional Pyramid

FCPFNet: Feature Complementation Network with Pyramid Fusion for Semantic Segmentation

SSAP: Single-Shot Instance Segmentation With Affinity Pyramid

Semantic Segmentation for Urban-Scene Images

High-performance Semantic Segmentation Using Very Deep Fully Convolutional Networks

Real-time efficient semantic segmentation network based on improved ASPP and parallel fusion module in complex scenes

High-Order Semantic Decoupling Network for Remote Sensing Image Semantic Segmentation

HDNet: Hybrid Distance Network for semantic segmentation

Dual-Path Geometry-Aware Network for Semantic Segmentation of High-Resolution Aerial Images

High-Resolution Aerial Imagery Semantic Labeling With Dense Pyramid Network

Semantic Segmentation of Aerial Imagery Via Split-Attention Networks with Disentangled Nonlocal and Edge Supervision

ASPP+-LANet: A Multi-Scale Context Extraction Network for Semantic Segmentation of High-Resolution Remote Sensing Images

Discriminative Features Reconstruction Network For Semantic Segmentation

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation