Abstract:Recently, a large amount of work has emerged for knowledge graph completion (KGC), which aims to reason over known facts and to infer the missing links. Meanwhile, contrastive learning has been applied to the KGC tasks, which can improve the representation quality of entities and relations. However, existing KGC approaches tend to improve their performance with high-dimensional embeddings and complex models, which make them suffer from large storage space and high training costs. Furthermore, contrastive loss with single positive sample learns little structural and semantic information in knowledge graphs due to the complex relation types. To address these challenges, we propose a novel knowledge graph completion model named ConKGC with the embedding dimension scaling and a relation-aware multi-positive contrastive loss. In order to achieve both space consumption reduction and model performance improvement, a new scoring function is proposed to map the raw low-dimensional embeddings of entities and relations to high-dimensional embedding space, and predict low-dimensional tail entities with latent semantic information of high-dimensional embeddings. In addition, ConKGC designs a multiple weak positive samples based contrastive loss under different relation types to maintain two important training targets, Alignment and Uniformity. This loss function and few parameters of the model ensure that ConKGC performs best and has fast convergence speed. Extensive experiments on three standard datasets confirm the effectiveness of our innovations, and the performance of ConKGC is significantly improved compared to the state-of-the-art methods.

Boosting BERT-Based Knowledge Graph Completion with Contrastive Learning and Hard Sample Training

Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph Completion

Relation-Aware Multi-Positive Contrastive Knowledge Graph Completion with Embedding Dimension Scaling

A knowledge graph completion model based on contrastive learning and relation enhancement method

Federated Knowledge Graph Completion Via Embedding-Contrastive Learning

Improving Knowledge Graph Completion with Structure-Aware Supervised Contrastive Learning

GLSEC: Global and Local Semantic-Enhanced Contrastive Framework for Knowledge Graph Completion

SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models

GLSEC:Global and local semantic-enhanced contrastive framework for knowledge graph completion

Subgraph-Aware Training of Language Models for Knowledge Graph Completion Using Structure-Aware Contrastive Learning

A Contextualized BERT model for Knowledge Graph Completion

KERMIT: Knowledge Graph Completion of Enhanced Relation Modeling with Inverse Transformation

Knowledge Graph Completion Algorithm with Multi-view Contrastive Learning

KRACL: Contrastive Learning with Graph Context Modeling for Sparse Knowledge Graph Completion

Semantic-Enhanced Knowledge Graph Completion

Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling

Disentangled Relational Graph Neural Network with Contrastive Learning for Knowledge Graph Completion

Knowledge Graph Completion Via Multi-feature Learning

Unifying Structure and Language Semantic for Efficient Contrastive Knowledge Graph Completion with Structured Entity Anchors

KGE-CL: Contrastive Learning of Knowledge Graph Embeddings

Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completion