Abstract:Knowledge graphs (KGs) have recently become increasingly popular due to the broad range of essential applications in various downstream tasks including intelligent search, personalized recommendations, intelligent financial data analytics, etc. During an automated construction of a KG, the knowledge facts from multiple knowledge sources are automatically extracted in the form of triples, and these observed triples are used to derive new unobserved triples for KG completion (also known as link prediction). State-of-the-art link prediction methods are known to be primarily KG embedding models, among which tensor factorization models have recently drawn much attention due to their scalability and expressive feature embeddings, and hence, perform well for link prediction. However, these embedding models consider each KG triple individually and fail to capture the useful information present in the neighborhood of a node. To this end, we propose a novel end-to-end KG embedding learning framework that consists of an encoder of a dual weighted graph convolutional network, and a decoder of a novel fully expressive tensor factorization model. The proposed encoder extends weighted graph convolutional network to generate two rich and high quality embedding vectors for each node by aggregating information from the neighboring nodes. The proposed decoder has a flexible and powerful tensor representation form of the Tensor Train decomposition that takes benefit of the two representations of each node in its embedding space to accurately model the KG triples. We also derive a bound on the size of the embeddings for full expressivity and show that our proposed tensor factorization model is fully expressive. Additionally, we show the relationship of our tensor factorization model to previous tensor factorization models. The experimental results show the effectiveness of the proposed framework that consistently marks performance gains over several previous models on recent standard link prediction datasets.

Large-scale knowledge graph representation learning

Distributed Representation Learning of Knowledge Graph with Diverse Information

KGNN: Distributed Framework for Graph Neural Knowledge Representation

PDKE: An Efficient Distributed Embedding Framework for Large Knowledge Graphs

Multiple Run Ensemble Learning with Low-Dimensional Knowledge Graph Embeddings

DGL-KE: Training Knowledge Graph Embeddings at Scale

Hierarchical Embedding Methods for Large-scale Complex Knowledge Graphs

Meta-Learning Based Knowledge Extrapolation for Knowledge Graphs in the Federated Setting.

Distribution Knowledge Embedding for Graph Pooling

KGEL: A novel end-to-end embedding learning framework for knowledge graph completion

Expeditious Generation of Knowledge Graph Embeddings

A Survey on Knowledge Graph Structure and Knowledge Graph Embeddings

Knowledge Graph Embedding Technology:A Review

Efficiently Embedding Dynamic Knowledge Graphs

International Workshop on Learning with Knowledge Graphs: Construction, Embedding, and Reasoning.

RelaGraph: Improving Embedding on Small-Scale Sparse Knowledge Graphs by Neighborhood Relations

Universal Knowledge Graph Embeddings

Learning hierarchy-aware complex knowledge graph embeddings for link prediction

A Birds Eye View on Knowledge Graph Embeddings, Software Libraries, Applications and Challenges

Knowledge Graph Embedding: An Overview

Knowledge Graph Embedding with Hierarchical Relation Structure