Abstract:Traditional way of storing facts in triplets (head_entity, relation, tail_entity), abbreviated as (h, r, t), allows the knowledge to be intuitively displayed and easily acquired by human beings, but hardly computed or even reasoned about by AI machines. Inspired by the success in applying Distributed Representations to AI-related fields, recent studies expect to represent each entity and relation with a unique low-dimensional embedding, which is different from the symbolic and atomic framework of displaying knowledge in triplets. In this way, the knowledge computing and reasoning can be essentially facilitated by means of a simple vector calculation, i.e. h + r ≈ t. We thus contribute an effective model to learn better embeddings satisfying the formula by pulling the positive tail entities t+ together and close to h + r (Nearest Neighbor), and simultaneously pushing the negatives t-away from the positives t+ via keeping a Large Margin. We also design a corresponding learning algorithm to efficiently find the optimal solution based on Stochastic Gradient Descent in iterative fashion. Quantitative experiments illustrate that our approach can achieve the state-of-the-art performance, compared with several recent methods on some benchmark datasets for two classical applications, i.e. Link prediction and Triplet classification. Moreover, we analyze the parameter complexities among all the evaluated models, and analytical results indicate that our model needs fewer computational resources while outperforming the other methods.

Probabilistic Belief Embedding for Large-Scale Knowledge Population

Probabilistic Belief Embedding for Knowledge Base Completion.

Incorporating Probabilistic Knowledge into Topic Models.

Knowledge Graph Embedding with Diversity of Structures

Universal Knowledge Graph Embeddings

Large Margin Nearest Neighbor Embedding for Knowledge Representation

Learning Embedding Representations for Knowledge Inference on Imperfect and Incomplete Repositories

Multi-Source Bayesian Embeddings for Learning Social Knowledge Graphs.

Learning Better Word Embedding by Asymmetric Low-Rank Projection of Knowledge Graph

Multi-Modal Bayesian Embeddings for Learning Social Knowledge Graphs

Knowledge Graph Embedding: An Overview

ProjE: Embedding Projection for Knowledge Graph Completion

Empowering Small-Scale Knowledge Graphs: A Strategy of Leveraging General-Purpose Knowledge Graphs for Enriched Embeddings

Expeditious Generation of Knowledge Graph Embeddings

Knowledge Graph Embedding Via Reasoning over Entities, Relations, and Text

Knowledge Bases in Support of Large Language Models for Processing Web News

A Probabilistic Method for Linking Bi Provenances to Open Knowledge Base

Unsupervised Knowledge Graph Alignment by Probabilistic Reasoning and Semantic Embedding

Static Embeddings as Efficient Knowledge Bases?

Bayes EMbedding (BEM): Refining Representation by Integrating Knowledge Graphs and Behavior-specific Networks

Joint Inference for Knowledge Base Population