Abstract:In knowledge graph embedding, an attempt is made to embed the objective facts and relationships expressed in the form of triplets into multidimensional vector space, facilitating various applications, such as link prediction and question answering. Structure embedding models focus on the graph structure while the importance of language semantics in inferring similar entities and relations is ignored. Semantic embedding models use pretrained language models to learn entity and relation embeddings based on text information, but they do not fully exploit graph structures that reflect relation patterns and mapping attributes. Structure and semantic information in knowledge graphs represent different hierarchical properties that are indispensable for comprehensive knowledge representation. In this paper, we propose a general knowledge graph embedding framework named SSKGE, which considers both the graph structure and language semantics and learns these two complementary characteristics to integrate entity and relation representations. To compensate for semantic embedding approaches that ignore the graph structure, we first design a structure loss function to explicitly model the graph structure attributes. Second, we leverage a pretrained language model that has been fine-tuned by the structure loss to guide the structure embedding approaches in enhancing the semantic information they lack and obtaining universal knowledge representations. Specifically, guidance is provided by a distance function that makes the spatial distribution of the two types of graph embeddings have a certain similarity. SSKGE significantly reduces the time cost of using a pretrained language model to complete a knowledge graph. Common knowledge graph embedding models such as TransE, DistMult, ComplEx, RotatE, PairRE, and HousE have achieved better results with multiple datasets, including FB15k, FB15k-237, WN18, and WN18RR, using the SSKGE framework. Extensive experiments and analyses have verified the effectiveness and practicality of SSKGE.

FSTRE: Fuzzy Spatiotemporal RDF Knowledge Graph Embedding Using Uncertain Dynamic Vector Projection and Rotation

SSTKG: Simple Spatio-Temporal Knowledge Graph for Intepretable and Versatile Dynamic Information Embedding

Uncertain Ontology-Aware Knowledge Graph Embeddings

Knowledge Graph Embedding with Diversity of Structures

Efficiently Embedding Dynamic Knowledge Graphs

Temporal Knowledge Graph Embedding Via Sparse Transfer Matrix

Meta-Learning Based Knowledge Extrapolation for Knowledge Graphs in the Federated Setting.

SSKGE: a time-saving knowledge graph embedding framework based on structure enhancement and semantic guidance

SpherE: Expressive and Interpretable Knowledge Graph Embedding for Set Retrieval

GAKE: Graph Aware Knowledge Embedding.

Geometric Feature Enhanced Knowledge Graph Embedding and Spatial Reasoning

FedE: Embedding Knowledge Graphs in Federated Setting

Data fusing driven graph embedding model for multi-source heterogeneous knowledge graph

An Adaptive Representation Model for Geoscience Knowledge Graphs Considering Complex Spatiotemporal Features and Relationships

Knowledge Graph Embedding by Normalizing Flows

Knowledge Graph Embedding by Flexible Translation

Time-Aware Graph Embedding: A Temporal Smoothness and Task-Oriented Approach

Extrapolation over temporal knowledge graph via hyperbolic embedding

GeoEntity-type constrained knowledge graph embedding for predicting natural-language spatial relations

Improving Static and Temporal Knowledge Graph Embedding Using Affine Transformations of Entities

Spatiotemporal knowledge graph completion via diachronic and transregional word embedding