Abstract:Knowledge graphs (KGs) have recently become increasingly popular due to the broad range of essential applications in various downstream tasks including intelligent search, personalized recommendations, intelligent financial data analytics, etc. During an automated construction of a KG, the knowledge facts from multiple knowledge sources are automatically extracted in the form of triples, and these observed triples are used to derive new unobserved triples for KG completion (also known as link prediction). State-of-the-art link prediction methods are known to be primarily KG embedding models, among which tensor factorization models have recently drawn much attention due to their scalability and expressive feature embeddings, and hence, perform well for link prediction. However, these embedding models consider each KG triple individually and fail to capture the useful information present in the neighborhood of a node. To this end, we propose a novel end-to-end KG embedding learning framework that consists of an encoder of a dual weighted graph convolutional network, and a decoder of a novel fully expressive tensor factorization model. The proposed encoder extends weighted graph convolutional network to generate two rich and high quality embedding vectors for each node by aggregating information from the neighboring nodes. The proposed decoder has a flexible and powerful tensor representation form of the Tensor Train decomposition that takes benefit of the two representations of each node in its embedding space to accurately model the KG triples. We also derive a bound on the size of the embeddings for full expressivity and show that our proposed tensor factorization model is fully expressive. Additionally, we show the relationship of our tensor factorization model to previous tensor factorization models. The experimental results show the effectiveness of the proposed framework that consistently marks performance gains over several previous models on recent standard link prediction datasets.

An Entity-Weights-based Convolutional Neural Network for Large-Sale Complex Knowledge Embedding

Multi-Scale Dynamic Convolutional Network for Knowledge Graph Embedding

RIECN: Learning Relation-Based Interactive Embedding Convolutional Network for Knowledge Graph.

Entity Relation Interactive Graph Convolutional Network for Knowledge Embedding

A Knowledge Graph Embedding Method Based on Neural Network

Multi-scale Dilated Convolutional Network for Knowledge Graph Embedding

Enhancing Knowledge Graph Embedding by Composite Neighbors for Link Prediction

Knowledge Graph Embedding Using a Multi-Channel Interactive Convolutional Neural Network with Triple Attention

Convolutional Models with Multi-Feature Fusion for Effective Link Prediction in Knowledge Graph Embedding

Improving Knowledge Graph Embedding Using Dynamic Aggregation of Neighbor Information.

Hierarchical Embedding Methods for Large-scale Complex Knowledge Graphs

Convolutional Network Embedding of Text-Enhanced Representation for Knowledge Graph Completion

Knowledge Graph Embedding with Entity Neighbors and Deep Memory Network

Multi-Filter soft shrinkage network for knowledge graph embedding

DeepE: a deep neural network for knowledge graph embedding

An End-to-End Structure Aware Graph Convolutional Network for Modeling Multi-relational Data

Knowledge Graph Embedding Method Based on Entity Metric Learning.

Knowledge graph embedding model with attention-based high-low level features interaction convolutional network

Multitask Graph Neural Network for Knowledge Graph Link Prediction.

A Knowledge Graph Link Prediction Model with Combined 1D and 2D Convolutional Embeddings

KGEL: A novel end-to-end embedding learning framework for knowledge graph completion