Abstract:Knowledge graph enhanced information retrieval systems have attracted considerable attention due to their ability to improve performance and provide additional explainability. As the knowledge graphs usually include fruitful facts, they are also good sources of side information. However, recent studies have shown that the usefulness of knowledge graphs depends highly on their representation, e.g., the embeddings of entities and relations. Embedding entities and relations in low-dimensional space is a successful knowledge graph representation solution. Most of the works lie in modeling symmetry/asymmetry/composition/inversion relations but pay less attention to the hierarchical relations. Recent studies have observed the fact that there exist rich semantic hierarchical relations in knowledge graphs such as Freebase (entities are connected in a taxonomic hierarchy) and WordNet (entities are synsets linked together in a hierarchy).To address the above problems, we propose Hierarchical Hyperbolic Neural Graph Embedding (H2E), a new knowledge graph representation approach, which is able to better preserve hierarchical relations. Specifically, the entities/relations representations are learned in a hyperbolic polar embedding space. In a hyperbolic polar embedding space, the entity and relation are modeled as a dual-embedding with modulus embedding part and phase embedding part, enabling the explicitly modeling of two types of hierarchies: inter-level hierarchy and intra-level hierarchy. As the polar embedding is defined i n hyperbolic space, the ability of modeling and inferring hierarchical relations are mutual enhanced. In addition, by noticing the existence of the rich relational context, we propose an attentional neural context aggregation to adaptively integrate the relational context for further enhancing the ability to preserve the hierarchical relations. The empirical study on three benchmark datasets for the link prediction task demonstrates significant performance gains compared to some existing state-of-the-art methods and verifies the effectiveness of the proposed method on hierarchical relations.

Learning hierarchy-aware complex knowledge graph embeddings for link prediction

Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction

Hyperbolic Hierarchical Knowledge Graph Embeddings for Link Prediction in Low Dimensions

Hierarchical Embedding Methods for Large-scale Complex Knowledge Graphs

Relation Embedding with Dihedral Group in Knowledge Graph

Knowledge Graph Representation Via Hierarchical Hyperbolic Neural Graph Embedding

HPRE: Leveraging hierarchy-aware paired relation vectors for knowledge graph embedding

Knowledge Graph Embedding with Hierarchical Relation Structure

Joint embedding in Hierarchical distance and semantic representation learning for link prediction

Hyperbolic Hierarchy-Aware Knowledge Graph Embedding for Link Prediction

Knowledge Graph Embedding with Diversity of Structures

Knowledge Graph Embedding for Hierarchical Entities Based on Auto-Embedding Size

DensE: An Enhanced Non-commutative Representation for Knowledge Graph Embedding with Adaptive Semantic Hierarchy

Dynamic relation learning for link prediction in knowledge hypergraphs

Dual Graph Embedding for Object-Tag Link Prediction on the Knowledge Graph.

Deep Hyperbolic Convolutional Model for Knowledge Graph Embedding

A Knowledge Graph Link Prediction Model with Combined 1D and 2D Convolutional Embeddings

DHGE: Dual-View Hyper-Relational Knowledge Graph Embedding for Link Prediction and Entity Typing

Dual Quaternion Embeddings for Link Prediction

Learning higher-order features for relation prediction in knowledge hypergraph

Dual Quaternion Knowledge Graph Embeddings