Abstract:<p>Knowledge graph (KG) embedding projects the graph into a low-dimensional space and preserves the graph information. An essential part of a KG is the ontology, which always is organized as a taxonomy tree, depicting the type (or multiple types) of each entity and the hierarchical relationships among these types. The importance of considering the ontology during KG embedding lies in its ability to provide side-information, improving the downstream applications' accuracy (e.g., link prediction, entity alignment or recommendation). However, the ontology has yet to receive adequate attention during the KG embedding, especially for instances where each entity may belong to multiple types. This ontology-enhanced KG embedding's main challenges are two-fold: determining how to discover the relationships among these types and how to integrate them with the entities' relationship network. Although it is common to see attention-based models used in KG embedding, they cannot settle the issues raised simultaneously. Only a single type is assigned to each entity and the correlation among types are ignored in those models, leading to information loss and encumbered downstream tasks. To overcome these challenges, we propose a composite multi-type aware KG embedding model, whose main components are a multi-type layer and entity embedding layer. We model it as a natural language processing task at the multi-type layer to discover each entity's multi-type feature and automatically capture their correlations. Additionally, a relation-based attention mechanism is conducted at the entity embedding layer, which aggregates neighborhoods' information and integrates the multi-type layer's information through common entities of these two layers. Through extensive experiments on two real KGs, we demonstrate that, compared to several state-of-the-art baselines, our Multi-Type aware Embedding (MTE) model achieves substantial gain in both Mean Rank and for the link prediction task and accuracy for multi-type classification.</p>

Fine-Grained Entity Typing for Relation-Sparsity Entities

Attributed and Predictive Entity Embedding for Fine-Grained Entity Typing in Knowledge Bases.

Knowledge Graph Entity Typing Via Learning Connecting Embeddings

Learning Entity Type Structured Embeddings with Trustworthiness on Noisy Knowledge Graphs

Type Hierarchy Enhanced Heterogeneous Network Embedding for Fine-Grained Entity Typing in Knowledge Bases

Relation-based multi-type aware knowledge graph embedding

Fine-Grained Entity Typing for Domain Independent Entity Linking

All Entities are Not Created Equal: Examining the Long Tail for Fine-Grained Entity Typing

Transformer-based Entity Typing in Knowledge Graphs

Connecting Embeddings Based on Multiplex Relational Graph Attention Networks for Knowledge Graph Entity Typing

Improving Neural Fine-Grained Entity Typing with Knowledge Attention.

Fine-Grained Entity-Type Completion Based on Neighborhood-Attention and Cartesian–Polar Coordinates Mapping

Entity Type Inference Based on Path Walking and Inter-Types Relationships

AsyncET: Asynchronous Learning for Knowledge Graph Entity Typing with Auxiliary Relations

The Integration of Semantic and Structural Knowledge in Knowledge Graph Entity Typing

Type-enriched Hierarchical Contrastive Strategy for Fine-Grained Entity Typing

GeoEntity-type constrained knowledge graph embedding for predicting natural-language spatial relations

CoType: Joint Extraction of Typed Entities and Relations with Knowledge Bases

Ultra-Fine Entity Typing with Prior Knowledge about Labels: A Simple Clustering Based Strategy

KTAT: A Complex Embedding Model of Knowledge Graph Integrating Type Information and Attention Mechanism

Liberal Entity Extraction: Rapid Construction of Fine-Grained Entity Typing Systems