Abstract:Knowledge Graph Embedding (KGE) aims to learn representations of entities and relations of knowledge graph (KG). Recently Graph Neural Networks (GNNs) have gained great success on KGE, but for the reason behind it, most views simply attribute to the well learning of knowledge graph structure, which still remains a limited understanding of the internal mechanism. In this work, we first study a fundamental problem, i.e., what are the important factors for GNNs to help KGE. To investigate this problem, we discuss the core idea of current GNN models for KG, and propose a new assumption of relational homophily that connected nodes possess similar features after relation's transforming, to explain why aggregating neighbors with relation can help KGE. Based on the model and empirical analyses, we then introduce a novel data-centric framework for applying GNNs to KGE called KSG-GNN . In KSG-GNN, we construct a new graph structure from KG named Knowledge Similarity Graph (KSG), where each node connects with its similar nodes as neighbors, and then we apply GNNs on this graph to perform KGE. Instead of following the relational homophily assumption in KG, KSG aligns with homogeneous graphs that can directly satisfy homophily assumption. Hence, any GNN developed on homogeneous graphs like GCN, GAT, GraphSAGE, etc., can be applied out-of-the-box as KSG-GNN without modification, which provides a more general and effective GNN paradigm. Finally, we conduct extensive experiments on two benchmark datasets, i.e., FB15k-237 and WN18RR, demonstrating the superior performance of KSG-GNN over multiple strong baselines. The source code is available at https://github.com/advancer99/WWWJ-KGE.

Wide Graph Neural Network

Wide and Deep Graph Neural Network with Distributed Online Learning

Wide and Deep Graph Neural Networks with Distributed Online Learning

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Nested Graph Neural Networks

GraphSAGE++: Weighted Multi-scale GNN for Graph Representation Learning

A Unified View on Graph Neural Networks as Graph Signal Denoising

A data-centric framework of improving graph neural networks for knowledge graph embedding

Learning Strong Graph Neural Networks with Weak Information

Universal Inceptive GNNs by Eliminating the Smoothness-generalization Dilemma

Graph Wavelet Neural Network

Feature Expansion for Graph Neural Networks

Revisiting graph neural networks from hybrid regularized graph signal reconstruction

Graph Neural Networks with Diverse Spectral Filtering

Meta-Weight Graph Neural Network: Push the Limits Beyond Global Homophily

Graph Neural Networks Inspired by Classical Iterative Algorithms

Bridging the Gap Between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networks

MathNet: Haar-Like Wavelet Multiresolution-Analysis for Graph Representation and Learning

Theoretically Improving Graph Neural Networks Via Anonymous Walk Graph Kernels

Graph Neural Networks Gone Hogwild

Learning the Network of Graphs for Graph Neural Networks