Abstract:Knowledge graphs (KGs) have recently become increasingly popular due to the broad range of essential applications in various downstream tasks including intelligent search, personalized recommendations, intelligent financial data analytics, etc. During an automated construction of a KG, the knowledge facts from multiple knowledge sources are automatically extracted in the form of triples, and these observed triples are used to derive new unobserved triples for KG completion (also known as link prediction). State-of-the-art link prediction methods are known to be primarily KG embedding models, among which tensor factorization models have recently drawn much attention due to their scalability and expressive feature embeddings, and hence, perform well for link prediction. However, these embedding models consider each KG triple individually and fail to capture the useful information present in the neighborhood of a node. To this end, we propose a novel end-to-end KG embedding learning framework that consists of an encoder of a dual weighted graph convolutional network, and a decoder of a novel fully expressive tensor factorization model. The proposed encoder extends weighted graph convolutional network to generate two rich and high quality embedding vectors for each node by aggregating information from the neighboring nodes. The proposed decoder has a flexible and powerful tensor representation form of the Tensor Train decomposition that takes benefit of the two representations of each node in its embedding space to accurately model the KG triples. We also derive a bound on the size of the embeddings for full expressivity and show that our proposed tensor factorization model is fully expressive. Additionally, we show the relationship of our tensor factorization model to previous tensor factorization models. The experimental results show the effectiveness of the proposed framework that consistently marks performance gains over several previous models on recent standard link prediction datasets.

TuckER: Tensor Factorization for Knowledge Graph Completion

Adaptive Regularizing Tucker Decomposition for Knowledge Graph Completion

Tucker decomposition-based Temporal Knowledge Graph Completion

Knowledge graph fact prediction via knowledge-enriched tensor factorization

Two Birds with One Stone: A Link Prediction Model for Knowledge Hypergraph Based on Fully-Connected Tensor Decomposition.

A Relational Tucker Decomposition for Multi-Relational Link Prediction

MvTuckER: Multi-view Knowledge Graphs Representation Learning Based on Tensor Tucker Model

MvTuckER: Multi-view knowledge graphs represention learning based on tensor tucker model

Scalable Tucker Factorization for Sparse Tensors - Algorithms and Discoveries

A tensor factorization model of multilayer network interdependence

Bayesian Sparse Tucker Models for Dimension Reduction and Tensor Completion

Infinite Tucker Decomposition: Nonparametric Bayesian Models for Multiway Data Analysis

Low-Rank and Sparse Enhanced Tucker Decomposition for Tensor Completion

KGEL: A novel end-to-end embedding learning framework for knowledge graph completion

Tucker Decomposition with Frequency Attention for Temporal Knowledge Graph Completion.

Hypernetwork Knowledge Graph Embeddings

Tucker tensor factor models: matricization and mode-wise PCA estimation

Rank-Adaptive Tensor Completion Based on Tucker Decomposition

Self-attention Presents Low-dimensional Knowledge Graph Embeddings for Link Prediction

A-Tucker: Fast Input-Adaptive and Matricization-Free Tucker Decomposition of Higher-Order Tensors on GPUs