Abstract:The pixel-based semantic segmentation methods take pixels as recognitions units, and are restricted by the limited range of receptive fields, so they cannot carry richer and higher-level semantics. These reduce the accuracy of remote sensing (RS) semantic segmentation to a certain extent. Comparing with the pixel-based methods, the graph neural networks (GNNs) usually use objects as input nodes, so they not only have relatively small computational complexity, but also can carry richer semantic information. However, the traditional GNNs are more rely on the context information of the individual samples and lack geographic prior knowledge that reflects the overall situation of the research area. Therefore, these methods may be disturbed by the confusion of “different objects with the same spectrum” or “violating the first law of geography” in some areas. To address the above problems, we propose a remote sensing semantic segmentation model called knowledge and spatial pyramid distance-based gated graph attention network (KSPGAT), which is based on prior knowledge, spatial pyramid distance and a graph attention network (GAT) with gating mechanism. The model first uses superpixels (geographical objects) to form the nodes of a graph neural network and then uses a novel spatial pyramid distance recognition algorithm to recognize the spatial relationships. Finally, based on the integration of feature similarity and the spatial relationships of geographic objects, a multi-source attention mechanism and gating mechanism are designed to control the process of node aggregation, as a result, the high-level semantics, spatial relationships and prior knowledge can be introduced into a remote sensing semantic segmentation network. The experimental results show that our model improves the overall accuracy by 4.43% compared with the U-Net Network, and 3.80% compared with the baseline GAT network.

SGA-Net: Self-Constructing Graph Attention Neural Network for Semantic Segmentation of Remote Sensing Images

Self-constructing graph neural networks to model long-range pixel dependencies for semantic segmentation of remote sensing images

Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net

Semantic Segmentation With Attention Mechanism for Remote Sensing Images

Graph Attention Guidance Network with Knowledge Distillation for Semantic Segmentation of Remote Sensing Images.

Hierarchical Self-Attention Embedded Neural Network With Dense Connection for Remote-Sensing Image Semantic Segmentation

Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images

Knowledge and Spatial Pyramid Distance-Based Gated Graph Attention Network for Remote Sensing Semantic Segmentation

Superpixel-Based Attention Graph Neural Network for Semantic Segmentation in Aerial Images

An Attention Enhanced Graph Convolutional Network for Semantic Segmentation

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

Multi-Attention-Network for Semantic Segmentation of Fine Resolution Remote Sensing Images

Dual Path Attention Net For Remote Sensing Semantic Image Segmentation

GraphUnet: Graph Make Strong Encoders for Remote Sensing Segmentation

AANet: Adaptive Attention Networks for Semantic Segmentation of High-Resolution Remote Sensing Imagery

Scale-Aware Neural Network for Semantic Segmentation of Multi-Resolution Remote Sensing Images

A Synergistical Attention Model for Semantic Segmentation of Remote Sensing Images

Multi-scale Spatial Aggregation Network for Remote Sensing Image Segmentation

MASANet: Multi-Angle Self-Attention Network for Semantic Segmentation of Remote Sensing Images

Accurate Semantic Segmentation in Remote Sensing Image.

Semantic Segmentation of Remote Sensing Image Based on Regional Self-Attention Mechanism