Abstract:Deep convolutional neural network (CNN), although recognized to be considerably successful in its application to semantic segmentation, is inadequate for extracting the overall structure information, for its representing images with the data in the Euclidean space. To improve this inadequacy, a new model in the graph domain that transforms semantic segmentation into graph node classification is proposed for semantic segmentation. In this model, the image is represented by a graph, with its nodes initialized by the feature map obtained by a CNN, and its edges reflecting the relationships of the nodes. The node relationships that are taken into consideration include distance-based ones and semantic ones, respectively, calculated with the Gauss kernel function and attention mechanism. The graph neural network is also introduced in this model for the classification of graph nodes, which can expand the receptive field without the loss of location information and combine the structure with the feature extraction. Most importantly, it is theoretically concluded that the proposed graph model takes the same role as a Laplace regularization term in image segmentation, which has been proven by multiple comparative experiments that show the effectiveness of the model in image semantic segmentation. The learned attention is visualized by the heatmap to validate the structure learning ability of our model. The results of these experiments show the importance of structural information in image segmentation. Hence, an idea of deep learning combined with graph structural information is provided in theory and method.

Gate Function Based Structure-Aware Convolution For Scene Semantic Segmentation

GFF: Gated Fully Fusion for Semantic Segmentation

Dense Convolution for Semantic Segmentation.

High-Resolution Remote Sensing Image Semantic Segmentation Method Based on Improved Encoder-Decoder Convolutional Neural Network

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

Towards Diverse Binary Segmentation via a Simple yet General Gated Network

Gated Path Selection Network for Semantic Segmentation

Class-related Graph Convolution for Weakly Supervised Semantic Segmentation

Fully Convolutional Networks for Semantic Segmentation

Distributed Iterative Gating Networks for Semantic Segmentation

Progressive Scene Segmentation Based on Self-Attention Mechanism.

Dense Convolutional Networks for Semantic Segmentation.

GateFormer: Gate Attention UNet With Transformer for Change Detection of Remote Sensing Images

CNN-G: Convolutional Neural Network Combined With Graph for Image Segmentation With Theoretical Analysis

Gated CNN: Integrating multi-scale feature layers for object detection

Learning High-level Prior with Convolutional Neural Networks for Semantic Segmentation

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

A Deeply Supervised Semantic Segmentation Method Based on GAN

Parallel Dense Merging Network with Dilated Convolutions for Semantic Segmentation of Sports Movement Scene.

Spatial Attention-Based Kernel Point Convolution Network for Semantic Segmentation of Transmission Corridor Scenarios in Airborne Laser Scanning Point Clouds