Abstract:In deep neural network model training and prediction, due to the limitation of GPU memory and computing resources, massive image data must be cropped into limited-sized samples. Moreover, in order to improve the generalization ability of the model, the samples need to be randomly distributed in the experimental area. Thus, the background information is often incomplete or even missing. On this condition, a knowledge graph must be applied to the semantic segmentation of remote sensing. However, although a single sample contains only a limited number of geographic categories, the combinations of geographic objects are diverse and complex in different samples. Additionally, the involved categories of geographic objects often span different classification system branches. Therefore, existing studies often directly regard all the categories involved in the knowledge graph as candidates for specific sample segmentation, which leads to high computation cost and low efficiency. To address the above problems, a parallel walking algorithm based on cross modality information is proposed for the scene graph—knowledge graph matching (PWGM). The algorithm uses a graph neural network to map the visual features of the scene graph into the semantic space of the knowledge graph through anchors and designs a parallel walking algorithm of the knowledge graph that takes into account the visual features of complex scenes. Based on the algorithm, we propose a semantic segmentation model for remote sensing. The experiments demonstrate that our model improves the overall accuracy by 3.7% compared with KGGAT (which is a semantic segmentation model using a knowledge graph and graph attention network (GAT)), by 5.1% compared with GAT and by 13.3% compared with U-Net. Our study not only effectively improves the recognition accuracy and efficiency of remote sensing objects, but also offers useful exploration for the development of deep learning from a data-driven to a data-knowledge dual drive.

Multi-Faceted Knowledge-Driven Graph Neural Network for Iris Segmentation

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

PGKD-Net: Prior-guided and Knowledge Diffusive Network for Choroid Segmentation

PFSegIris: Precise and Fast Segmentation Algorithm for Multi-Source Heterogeneous Iris

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Make U-Net Greater: An Easy-to-Embed Approach to Improve Segmentation Performance Using Hypergraph

Knowledge and Geo-Object Based Graph Convolutional Network for Remote Sensing Semantic Segmentation

Knowledge and Spatial Pyramid Distance-Based Gated Graph Attention Network for Remote Sensing Semantic Segmentation

ES-Net: Unet-based model for the semantic segmentation of Iris

Multimodal Remote Sensing Image Segmentation With Intuition-Inspired Hypergraph Modeling

Cross-scale Graph Interaction Network for Semantic Segmentation of Remote Sensing Images

Multi-level graph convolutional recurrent neural network for semantic image segmentation

FGCN: Image-Fused Point Cloud Semantic Segmentation with Fusion Graph Convolutional Network

Edge-Enhanced GCIFFNet: A Multiclass Semantic Segmentation Network Based on Edge Enhancement and Multiscale Attention Mechanism

Multi-scale Contourlet Knowledge Guide Learning Segmentation

IrisST-Net for Iris Segmentation and Contour Parameters Extraction

Graph based multi-scale neighboring topology deep learning for kidney and tumor segmentation

Segmenting Objects From Relational Visual Data

DADCNet: Dual Attention Densely Connected Network for More Accurate Real Iris Region Segmentation

Remote Sensing Scene Graph and Knowledge Graph Matching with Parallel Walking Algorithm

A Robust Iris Segmentation Scheme Based on Improved U-Net