Abstract:<p>Knowledge graph (KG) embedding projects the graph into a low-dimensional space and preserves the graph information. An essential part of a KG is the ontology, which always is organized as a taxonomy tree, depicting the type (or multiple types) of each entity and the hierarchical relationships among these types. The importance of considering the ontology during KG embedding lies in its ability to provide side-information, improving the downstream applications' accuracy (e.g., link prediction, entity alignment or recommendation). However, the ontology has yet to receive adequate attention during the KG embedding, especially for instances where each entity may belong to multiple types. This ontology-enhanced KG embedding's main challenges are two-fold: determining how to discover the relationships among these types and how to integrate them with the entities' relationship network. Although it is common to see attention-based models used in KG embedding, they cannot settle the issues raised simultaneously. Only a single type is assigned to each entity and the correlation among types are ignored in those models, leading to information loss and encumbered downstream tasks. To overcome these challenges, we propose a composite multi-type aware KG embedding model, whose main components are a multi-type layer and entity embedding layer. We model it as a natural language processing task at the multi-type layer to discover each entity's multi-type feature and automatically capture their correlations. Additionally, a relation-based attention mechanism is conducted at the entity embedding layer, which aggregates neighborhoods' information and integrates the multi-type layer's information through common entities of these two layers. Through extensive experiments on two real KGs, we demonstrate that, compared to several state-of-the-art baselines, our Multi-Type aware Embedding (MTE) model achieves substantial gain in both Mean Rank and for the link prediction task and accuracy for multi-type classification.</p>

METransE: Manifold-like Mechanism Enhanced Embedding for Reasoning over Knowledge Graphs

Meta-Knowledge Transfer for Inductive Knowledge Graph Embedding

Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspective

Relation-based multi-type aware knowledge graph embedding

Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoning

GTrans: Generic Knowledge Graph Embedding Via Multi-State Entities and Dynamic Relation Spaces

TransE-MTP: A New Representation Learning Method for Knowledge Graph Embedding with Multi-Translation Principles and TransE

Transg : A Generative Model For Knowledge Graph Embedding

Knowledge Graph Embedding with Diversity of Structures

Transition-based Knowledge Graph Embedding with Relational Mapping Properties

On The Expressive Power of Knowledge Graph Embedding Methods

Heuristic-Driven, Type-Specific Embedding in Parallel Spaces for Enhancing Knowledge Graph Reasoning.

Knowledge Graph Embedding Via Reasoning over Entities, Relations, and Text

MRE: A Translational Knowledge Graph Completion Model Based on Multiple Relation Embedding

TransT: Type-Based Multiple Embedding Representations for Knowledge Graph Completion.

RulE: Knowledge Graph Reasoning with Rule Embedding

MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoning

A Hybrid Model for Learning Embeddings and Logical Rules Simultaneously from Knowledge Graphs

TransET: Knowledge Graph Embedding with Entity Types

Rule-enhanced Iterative Complementation for Knowledge Graph Reasoning

TransMS: Knowledge Graph Embedding for Complex Relations by Multidirectional Semantics