Abstract:Knowledge Graph Embedding (KGE) aims to learn representations of entities and relations of knowledge graph (KG). Recently Graph Neural Networks (GNNs) have gained great success on KGE, but for the reason behind it, most views simply attribute to the well learning of knowledge graph structure, which still remains a limited understanding of the internal mechanism. In this work, we first study a fundamental problem, i.e., what are the important factors for GNNs to help KGE. To investigate this problem, we discuss the core idea of current GNN models for KG, and propose a new assumption of relational homophily that connected nodes possess similar features after relation's transforming, to explain why aggregating neighbors with relation can help KGE. Based on the model and empirical analyses, we then introduce a novel data-centric framework for applying GNNs to KGE called KSG-GNN . In KSG-GNN, we construct a new graph structure from KG named Knowledge Similarity Graph (KSG), where each node connects with its similar nodes as neighbors, and then we apply GNNs on this graph to perform KGE. Instead of following the relational homophily assumption in KG, KSG aligns with homogeneous graphs that can directly satisfy homophily assumption. Hence, any GNN developed on homogeneous graphs like GCN, GAT, GraphSAGE, etc., can be applied out-of-the-box as KSG-GNN without modification, which provides a more general and effective GNN paradigm. Finally, we conduct extensive experiments on two benchmark datasets, i.e., FB15k-237 and WN18RR, demonstrating the superior performance of KSG-GNN over multiple strong baselines. The source code is available at https://github.com/advancer99/WWWJ-KGE.

Amalgamating Knowledge from Heterogeneous Graph Neural Networks

Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural Networks

Attribution Guided Layerwise Knowledge Amalgamation from Graph Neural Networks

Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph Completion

Customizing Student Networks From Heterogeneous Teachers Via Adaptive Knowledge Amalgamation

Knowledge Amalgamation from Heterogeneous Networks by Common Feature Learning

Teaching MLPs to Master Heterogeneous Graph-Structured Knowledge for Efficient and Accurate Inference

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks

Amalgamating Knowledge towards Comprehensive Classification

Alignahead: Online Cross-Layer Knowledge Extraction on Graph Neural Networks

Multi-Scale Distillation from Multiple Graph Neural Networks

Online Adversarial Knowledge Distillation for Graph Neural Networks

Boosting Graph Neural Networks via Adaptive Knowledge Distillation

A data-centric framework of improving graph neural networks for knowledge graph embedding

Knowledge Transfer Graph for Deep Collaborative Learning

Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks

Distilling Holistic Knowledge with Graph Neural Networks

Compressing Deep Graph Neural Networks via Adversarial Knowledge Distillation

Online Cross-Layer Knowledge Distillation on Graph Neural Networks with Deep Supervision

Distilling Knowledge from Graph Convolutional Networks

Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation