Abstract:Knowledge graphs (KGs) have gradually become valuable assets for many AI applications. In a KG, a node denotes an entity, and an edge (or link) denotes a relationship between the entities represented by the nodes. Knowledge graph completion infers and predicts missing edges in a KG automatically. Knowledge graph embeddings have shed light on addressing this task. Recent research embeds KGs in hyperbolic (negatively curved) space instead of conventional Euclidean (zero curved) space and is effective in capturing hierarchical structures. However, as multi-relational graphs, KGs are not structured uniformly and display intrinsic heterogeneous structures. They usually contain rich types of structures, such as hierarchical and cyclic typed structures. Embedding KGs in single-curvature space, such as Euclidean or hyperbolic space, overlooks the intrinsic heterogeneous structures of KGs, and therefore cannot accurately capture their structures. To address this issue, we propose Mixed-Curvature Multi-Relational Graph Neural Network (M2GNN), a generic approach that embeds multi-relational KGs in a mixed-curvature space for knowledge graph completion. Specifically, we define and construct a mixed-curvature space through a product manifold combining multiple single-curvature spaces (e.g., spherical, hyperbolic, or Euclidean) with the purpose of modeling a variety of structures. However, constructing a mixed-curvature space typically requires manually defining the fixed curvatures, which needs domain knowledge and additional data analysis. Improperly defined curvature space also cannot capture the structures of KGs accurately. To address this problem, we set mixed-curvatures as trainable parameters to better capture the underlying structures of the KGs. Furthermore, we propose a Graph Neural Updater by leveraging the heterogeneous relational context in mixed-curvature space to improve the quality of the embedding. Experiments on three KG datasets demonstrate that the proposed M2GNN can outperform its single geometry counterpart as well as state-of-the-art embedding methods on the KG completion task.

Research on the application of Neural Network Model in Knowledge graph completion technology

Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph Completion

Knowledge Graph Completion: A Review

A Comprehensive Survey of Graph Neural Networks for Knowledge Graphs

Are Message Passing Neural Networks Really Helpful for Knowledge Graph Completion?

A Survey on Graph Neural Networks for Knowledge Graph Completion

Hierarchical Perceptual Graph Attention Network for Knowledge Graph Completion

Semantic- and relation-based graph neural network for knowledge graph completion

A comprehensive overview of knowledge graph completion

Knowledge Enhanced Graph Neural Networks for Graph Completion

A knowledge graph completion model based on contrastive learning and relation enhancement method

Semantic-Enhanced Knowledge Graph Completion

Knowledge Graph Completion Based on Graph Representation and Probability Model

Research progress of large-scale knowledge graph completion technology

Large Models and Multimodal: A Survey of Cutting-Edge Approaches to Knowledge Graph Completion

Attention-Based Aggregation Graph Networks for Knowledge Graph Information Transfer

Mixed-Curvature Multi-Relational Graph Neural Network for Knowledge Graph Completion

A Survey of Few-Shot Knowledge Graph Completion

ShallowBKGC: a BERT-enhanced shallow neural network model for knowledge graph completion

Exploring & Exploiting High-Order Graph Structure for Sparse Knowledge Graph Completion