Abstract:Knowledge graph embedding converts knowledge graphs based on symbolic representations into low-dimensional vectors. Effective knowledge graph embedding methods are key to ensuring downstream tasks. Some studies have shown significant performance differences among various knowledge graph embedding models on different datasets. They attribute this issue to the insufficient representation ability of the models. However, what representation ability knowledge graph embedding models possess is still unknown. Therefore, this paper first selects three representative models for analysis: translation and rotation models in distance models, and the Bert model in neural network models. Based on the analysis results, it can be concluded that the translation model focuses on clustering features, the rotation model focuses on hierarchy features, and the Bert model focuses on word co-occurrence features. This paper categorize clustering and hierarchy as structure features, and word co-occurrence as semantic features. Furthermore, a model that solely focuses on a single feature will lead to a lack of accuracy and generality, making it challenging for the model to be applicable to modern large-scale knowledge graphs. Therefore, this paper proposes an ensemble model with structure and semantic features for knowledge graph embedding. Specifically, the ensemble model includes a structure part and a semantic part. The structure part consists of three models: translation, rotation and cross. Translation and rotation models serve as basic feature extraction, while the cross model enhances the interaction between them. The semantic part is built based on Bert and integrated with the structure part after fine-tuning. In addition, this paper also introduces a frequency model to mitigate the training imbalance caused by differences in entity frequencies. Finally, we verify the effectiveness of the model through link prediction. Experiments show that the ensemble model has achieved improvement on FB15k-237 and YAGO3-10, and also has good performance on WN18RR, proving the effectiveness of the model.

Learning representations for gene ontology terms by jointly encoding graph structure and textual node descriptors

DeepGOA: Predicting Gene Ontology Annotations of Proteins Via Graph Convolutional Network

Partial order relation–based gene ontology embedding improves protein function prediction

Learning Complete Protein Representation by Deep Coupling of Sequence and Structure

Graph-in-Graph Network for Automatic Gene Ontology Description Generation

Comparative Analysis of Unsupervised Protein Similarity Prediction Based on Graph Embedding

OntoProtein: Protein Pretraining With Gene Ontology Embedding

Learning Structural Genetic Information via Graph Neural Embedding

TransformerGO: predicting protein-protein interactions by modelling the attention between sets of gene ontology terms

Knowledge Graph Embedding with Diversity of Structures

Graph2GO: a multi-modal attributed network embedding method for inferring protein functions

edge2vec: Representation learning using edge semantics for biomedical knowledge discovery

Embedding Words in Non-Vector Space with Unsupervised Graph Learning

A Deep Learning Framework for Gene Ontology Annotations with Sequence- and Network-Based Information

Text-Graph Enhanced Knowledge Graph Representation Learning.

Learning Term Embeddings for Lexical Taxonomies

Tag2Vec: Learning Tag Representations in Tag Networks

CMG2Vec: A composite meta-graph based heterogeneous information network embedding approach

A Measure of Semantic Similarity Between Gene Ontology Terms Based on Semantic Pathway Covering

ProtGO: A Transformer based Fusion Model for accurately predicting Gene Ontology (GO) Terms from full scale Protein Sequences

Enhancing knowledge graph embedding with structure and semantic features