Toxins of higher fungi.

L. R. Brady

Abstract:

What problem does this paper attempt to address?

Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph Completion

Bin Shang,Yinliang Zhao,Jun Liu,Di Wang

DOI: https://doi.org/10.1609/aaai.v38i8.28745

2024-01-01

Abstract:Knowledge graph completion (KGC) aims to study the embedding representation to solve the incompleteness of knowledge graphs (KGs). Recently, graph convolutional networks (GCNs) and graph attention networks (GATs) have been widely used in KGC tasks by capturing neighbor information of entities. However, Both GCNs and GATs based KGC models have their limitations, and the best method is to analyze the neighbors of each entity (pre-validating), while this process is prohibitively expensive. Furthermore, the representation quality of the embeddings can affect the aggregation of neighbor information (message passing). To address the above limitations, we propose a novel knowledge graph completion model with mixed geometry message and trainable convolutional attention network named MGTCA. Concretely, the mixed geometry message function generates rich neighbor message by integrating spatially information in the hyperbolic space, hypersphere space and Euclidean space jointly. To complete the autonomous switching of graph neural networks (GNNs) and eliminate the necessity of pre-validating the local structure of KGs, a trainable convolutional attention network is proposed by comprising three types of GNNs in one trainable formulation. Furthermore, a mixed geometry scoring function is proposed, which calculates scores of triples by novel prediction function and similarity function based on different geometric spaces. Extensive experiments on three standard datasets confirm the effectiveness of our innovations, and the performance of MGTCA is significantly improved compared to the state-of-the-art approaches.
Multi-relational graph attention networks for knowledge graph completion

Zhifei Li,Yue Zhao,Yan Zhang,Zhaoli Zhang

DOI: https://doi.org/10.1016/j.knosys.2022.109262

2022-09-05

Abstract:Knowledge graphs are multi-relational data that contain massive entities and relations. As an effective graph representation technique based on deep learning, graph neural network has reported outstanding performance for modeling knowledge graphs in recent studies. However, previous graph neural network-based models have not fully considered the heterogeneity of knowledge graphs. Furthermore, the attention mechanism has demonstrated its great potential in many areas. In this paper, a novel heterogeneous graph neural network framework based on a hierarchical attention mechanism is proposed, including entity-level, relation-level, and self-level attentions. Thus, the proposed model can selectively aggregate informative features and weights them adequately. Then the learned embeddings of entities and relations can be utilized for the downstream tasks. Extensive experimental results on various heterogeneous graph tasks demonstrate the superior performance of the proposed model compared to several state-of-the-art methods.

computer science, artificial intelligence
NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Hu Jianke,Zhang Yin

DOI: https://doi.org/10.1631/fitee.2000657

2022-01-01

Abstract:Recently, graph neural networks (GNNs) have achieved remarkable performance in representation learning on graph-structured data. However, as the number of network layers increases, GNNs based on the neighborhood aggregation strategy deteriorate due to the problem of oversmoothing, which is the major bottleneck for applying GNNs to real-world graphs. Many efforts have been made to improve the process of feature information aggregation from directly connected nodes, i.e., breadth exploration. However, these models perform the best only in the case of three or fewer layers, and the performance drops rapidly for deep layers. To alleviate oversmoothing, we propose a nested graph attention network (NGAT), which can work in a semi-supervised manner. In addition to breadth exploration, a k-layer NGAT uses a layer-wise aggregation strategy guided by the attention mechanism to selectively leverage feature information from the kth-order neighborhood, i.e., depth exploration. Even with a 10-layer or deeper architecture, NGAT can balance the need for preserving the locality (including root node features and the local structure) and aggregating the information from a large neighborhood. In a number of experiments on standard node classification tasks, NGAT outperforms other novel models and achieves state-of-the-art performance.
Hierarchical Perceptual Graph Attention Network for Knowledge Graph Completion

Wenhao Han,Xuemei Liu,Jianhao Zhang,Hairui Li

DOI: https://doi.org/10.3390/electronics13040721

IF: 2.9

2024-02-10

Electronics

Abstract:Knowledge graph completion (KGC), the process of predicting missing knowledge through known triples, is a primary focus of research in the field of knowledge graphs. As an important graph representation technique in deep learning, graph neural networks (GNNs) perform well in knowledge graph completion, but most existing graph neural network-based knowledge graph completion methods tend to aggregate neighborhood information directly and individually, ignoring the rich hierarchical semantic structure of KGs. As a result, how to effectively deal with multi-level complex relations is still not well resolved. In this study, we present a hierarchical knowledge graph completion technique that combines both relation-level and entity-level attention and incorporates a weight matrix to enhance the significance of the embedded information under different semantic conditions. Furthermore, it updates neighborhood information to the central entity using a hierarchical aggregation approach. The proposed model enhances the capacity to capture hierarchical semantic feature information and is adaptable to various scoring functions as decoders, thus yielding robust results. We conducted experiments on a public benchmark dataset and compared it with several state-of-the-art models, and the experimental results indicate that our proposed model outperforms existing models in several aspects, proving its superior performance and validating the effectiveness of the model.

engineering, electrical & electronic,computer science, information systems,physics, applied
Hyper-node Relational Graph Attention Network for Multi-modal Knowledge Graph Completion

Shuang Liang,Anjie Zhu,Jiasheng Zhang,Jie Shao

DOI: https://doi.org/10.1145/3545573

2023-02-06

Abstract:Knowledge graphs often suffer from incompleteness, and knowledge graph completion (KGC) aims at inferring the missing triplets through knowledge graph embedding from known factual triplets. However, most existing knowledge graph embedding methods only use the relational information of knowledge graph and treat the entities and relations as IDs with simple embedding layer, ignoring the multi-modal information among triplets, such as text descriptions, images, etc. In this work, we propose a novel network to incorporate different modal information with graph structure information for more precise representation of multi-modal knowledge graph, termed as hyper-node relational graph attention (HRGAT) network. In HRGAT, we use low-rank multi-modal fusion to model the intra-modality and inter-modality dynamics, which transforms the original knowledge graph to a hyper-node graph. Then, relational graph attention (RGAT) network is used, which contains relation-specific attention and entity-relation fusion operation to capture the graph structure information. Finally, we aggregate the updated multi-modal information and graph structure information to generate the final embeddings of knowledge graph to achieve KGC. By exploring multi-modal information and graph structure information, HRGAT embraces faster convergence speed and achieves the state-of-the-art for KGC on the standard datasets. Implementation code is available at https://github.com/broliang/HRGAT.

computer science, information systems, theory & methods, software engineering
Relational Graph Neural Network with Hierarchical Attention for Knowledge Graph Completion

Zhao Zhang,Fuzhen Zhuang,Hengshu Zhu,Zhiping Shi,Hui Xiong,Qing He

DOI: https://doi.org/10.1609/aaai.v34i05.6508

2020-04-03

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:The rapid proliferation of knowledge graphs (KGs) has changed the paradigm for various AI-related applications. Despite their large sizes, modern KGs are far from complete and comprehensive. This has motivated the research in knowledge graph completion (KGC), which aims to infer missing values in incomplete knowledge triples. However, most existing KGC models treat the triples in KGs independently without leveraging the inherent and valuable information from the local neighborhood surrounding an entity. To this end, we propose a Relational Graph neural network with Hierarchical ATtention (RGHAT) for the KGC task. The proposed model is equipped with a two-level attention mechanism: (i) the first level is the relation-level attention, which is inspired by the intuition that different relations have different weights for indicating an entity; (ii) the second level is the entity-level attention, which enables our model to highlight the importance of different neighboring entities under the same relation. The hierarchical attention mechanism makes our model more effective to utilize the neighborhood information of an entity. Finally, we extensively validate the superiority of RGHAT against various state-of-the-art baselines.
Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach

Wanxu Wei,Yitong Song,Bin Yao

DOI: https://doi.org/10.1145/3639472

IF: 4.157

2024-02-13

ACM Transactions on Knowledge Discovery from Data

Abstract:Knowledge graphs (KGs) play a vital role in enhancing search results and recommendation systems. With the rapid increase in the size of KGs, they are becoming inaccurate and incomplete. This problem can be solved by the KG completion methods, of which graph attention network (GAT)-based methods stand out because of their superior performance. However, existing GAT-based KG completion methods often suffer from overfitting issues when dealing with heterogeneous KGs, primarily due to the unbalanced number of samples. Additionally, these methods demonstrate poor performance in predicting the tail (head) entity that shares the same relation and head (tail) entity with others. To solve these problems, we propose GATH, a novel GAT -based method designed for H eterogeneous KGs. GATH incorporates two separate attention network modules that work synergistically to predict the missing entities. We also introduce novel encoding and feature transformation approaches, enabling the robust performance of GATH in scenarios with imbalanced samples. Comprehensive experiments are conducted to evaluate GATH’s performance. Compared with the existing state-of-the-art GAT-based model on Hits@10 and MRR metrics, our model improves performance by 5.2% and 5.2% on the FB15K-237 dataset and by 4.5% and 14.6% on the WN18RR dataset, respectively.

computer science, information systems, software engineering
GS-InGAT: An interaction graph attention network with global semantic for knowledge graph completion

Hong Yin,Jiang Zhong,Chen Wang,Rongzhen Li,Xue Li

DOI: https://doi.org/10.1016/j.eswa.2023.120380

IF: 8.5

2023-05-08

Expert Systems with Applications

Abstract:Knowledge graph completion (KGC) aims to infer missing links between entities based on the observed ones. Current KGC methods primarily focus on KG embedding models, which project entities and relations as low-dimensional vectors. Recently, the combination of textual information with graph neural network models has drawn extensive attention due to their superiority in utilizing topological structures, benefiting from the message passing mechanism, and their effectiveness in supplementing structural information. Nevertheless, previous methods suffer from the following two limitations. First, they always treat the textual information as an independent instance to enhance the corresponding entities, without considering the global semantic within the KG. Second, Graph Neural Networks (GNNs) typically assume that the neighbors of a node are independent of each other, ignoring the possible interactions between them. To eliminate these limitations, we creatively propose a KGC method called GS-InGAT (Interaction Graph ATtention Network with Global Semantic). Concretely, we utilize a semantic graph to model the semantic relationships and obtain the global semantic representations for entities based on it. Furthermore, we introduce an efficient Interaction Graph ATtention network (InGAT) that can simultaneously capture both the interaction and local information of entities, which can be fused to generate structural representations. Finally, we feed the combination of the semantic and structural representations, along with relation representations, into the decoder to score triples. Experimental results demonstrate that the GS-InGAT consistently attains comparable performance on benchmark datasets, verifying the effectiveness of considering the global semantic and interactions between neighbors.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
A knowledge graph completion model based on contrastive learning and relation enhancement method

LinYu Li,Xuan Zhang,YuBin Ma,Chen Gao,Jishu Wang,Yong Yu,Zihao Yuan,Qiuying Ma

DOI: https://doi.org/10.1016/j.knosys.2022.109889

2022-11-28

Abstract:The rapid development in knowledge graph (KG) technology and its popularity in the field of artificial intelligence (AI) have significantly increased the support for similar KG-based applications. However, there is a concerning problem regarding KGs; most of them are often incomplete. This motivated us to study knowledge graph completion (KGC). Some recent studies have used graph neural networks (GNN) such as graph convolutional networks (GCN) to model graph-structured data, providing good results on KGC tasks. However, the edge weights in GCN models are controlled by degree, a measure that moderately ignores the differences among relation information. To address the above limitations and obtain better KGC, we propose a model based on graph attention networks (GATs) and contrastive learning (CL), called the CLGAT-KGC model. This model introduces the graph attention mechanism and adds different representations of entities under the same entity corresponding to different relations to enhance the entity-relation message function. Additionally, a new CL method is proposed under the CLGAT-KGC model to better learn the embedding of entities and relations in the KG domain. We have completely verified the effectiveness of this model through extensive experiments.

computer science, artificial intelligence
r-GAT: Relational Graph Attention Network for Multi-Relational Graphs

Meiqi Chen,Yuan Zhang,Xiaoyu Kou,Yuntao Li,Yan Zhang

DOI: https://doi.org/10.48550/arxiv.2109.05922

2021-01-01

Abstract: Graph Attention Network (GAT) focuses on modelling simple undirected and single relational graph data only. This limits its ability to deal with more general and complex multi-relational graphs that contain entities with directed links of different labels (e.g., knowledge graphs). Therefore, directly applying GAT on multi-relational graphs leads to sub-optimal solutions. To tackle this issue, we propose r-GAT, a relational graph attention network to learn multi-channel entity representations. Specifically, each channel corresponds to a latent semantic aspect of an entity. This enables us to aggregate neighborhood information for the current aspect using relation features. We further propose a query-aware attention mechanism for subsequent tasks to select useful aspects. Extensive experiments on link prediction and entity classification tasks show that our r-GAT can model multi-relational graphs effectively. Also, we show the interpretability of our approach by case study.
An efficiency relation-specific graph transformation network for knowledge graph representation learning

Zhiwen Xie,Runjie Zhu,Jin Liu,Guangyou Zhou,Jimmy Xiangji Huang,Zhiwen Xie,Runjie Zhu,Jin Liu,Guangyou Zhou,Jimmy Xiangji Huang

DOI: https://doi.org/10.1016/j.ipm.2022.103076

2022-11-01

Abstract:Knowledge graph representation learning (KGRL) aims to infer the missing links between target entities based on existing triples. Graph neural networks (GNNs) have been introduced recently as one of the latest trendy architectures serves KGRL task using aggregations of neighborhood information. However, current GNN-based methods have fundamental limitations in both modelling the multi-hop distant neighbors and selecting relation-specific neighborhood information from vast neighbors. In this study, we propose a new relation-specific graph transformation network (RGTN) for the KGRL task. Specifically, the proposed RGTN is the first pioneer model that transforms a relation-based graph into a new path-based graph by generating useful paths that connect heterogeneous relations and multi-hop neighbors. Unlike the existing GNN-based methods, our approach is able to adaptively select the most useful paths for each specific relation and to effectively build path-based connections between unconnected distant entities. The transformed new graph structure opens a new way to model the arbitrary lengths of multi-hop neighbors which leads to more effective embedding learning. In order to verify the effectiveness of our proposed model, we conduct extensive experiments on three standard benchmark datasets, e.g., WN18RR, FB15k-237 and YAGO-10-DR. Experimental results show that the proposed RGTN achieves the promising results and even outperforms other state-of-the-art models on the KGRL task (e.g., compared to other state-of-the-art GNN-based methods, our model achieves 2.5% improvement using H@10 on WN18RR, 1.2% improvement using H@10 on FB15k-237 and 6% improvement using H@10 on YAGO3-10-DR).

computer science, information systems,information science & library science
Multi-head multi-order graph attention networks

Jie Ben,Qiguo Sun,Keyu Liu,Xibei Yang,Fengjun Zhang

DOI: https://doi.org/10.1007/s10489-024-05601-z

IF: 5.3

2024-06-21

Applied Intelligence

Abstract:The Graph Attention Network (GAT) is a type of graph neural network (GNN) that uses attention mechanisms to weigh the importance of nodes' neighbors, demonstrating flexibility and power in representation learning. However, GAT and its variants still face common challenges in GNNs, such as over-smoothing and over-squashing. To address this, we propose Multi-Head Multi-Order Graph Attention Networks (MHMOGAT) as an enhanced GAT layer. MHMOGAT is built based on multi-head attention and adjacency matrices of different orders, aiming to expand the receptive field of GAT to effectively capture long-distance dependencies. Moreover, Bayesian optimization is employed to determine optimal hyperparameter combinations for different datasets. Experimental results on six prevailing datasets demonstrate that MHMOGAT improves GAT accuracy by approximately 2-5% across various datasets with different label rates, indicating its effectiveness. Additionally, MHMOGAT exhibits potential in handling large and complex graphs with low label rates.

computer science, artificial intelligence
Semantic- and relation-based graph neural network for knowledge graph completion

Xinlu Li,Yujie Tian,Shengwei Ji

DOI: https://doi.org/10.1007/s10489-024-05482-2

IF: 5.3

2024-05-08

Applied Intelligence

Abstract:Knowledge graph completion (KGC) refines missing entities, relationships, or attributes from a knowledge graph, which is significant for referral systems, biological informatics, and search engines. As an effective KGC approach, a graph neural network (GNN) learns to aggregate information from neighboring nodes by iteratively passing messages between them. However, the semantic and relational information contained in knowledge graphs is rarely used in the existing GNN-based approaches for KGC (i.e., only structure information is used). Hence, a semantic- and relation-based GNN (SR-GNN) model, which combines the semantic similarity information between neighboring entities and the relational features of knowledge graphs, is proposed. First, we develop an entity semantic aggregation module that learns semantic similarity information among neighboring entities connected to the same central entity via an RNN. Second, we propose a relational aggregation module that captures the different semantics among different types of relations through a GRU. This enables the model to better comprehend semantic relationships and be applied to KGC tasks requiring relationship embedding vectors. Extensive studies conducted on the FB15k-237, WN18RR, WN18 and YAGO3-10 datasets reveal that, when compared to 17 baseline models, the SR-GNN exhibits state-of-the-art performance in terms of the MRR and H@n metrics. Significantly, the MRR metric improves by on the FB15K-237 dataset and by on the WN18RR dataset over those of the rival models.

computer science, artificial intelligence
Learnable convolutional attention network for knowledge graph completion

Bin Shang,Yinliang Zhao,Jun Liu

DOI: https://doi.org/10.1016/j.knosys.2023.111360

IF: 8.139

2024-01-07

Knowledge-Based Systems

Abstract:Recently, graph convolutional networks (GCNs) and graph attention networks (GATs) have been used extensively in knowledge graph completion (KGC), which aims to solve the incompleteness of knowledge graphs (KGs). However, both GCNs and GATs have limitations in the KGC task, and the best method is analyzing the neighbors of each entity (pre-validating), while this process is prohibitively expensive. Furthermore, relations in KGs have specific semantics and should be considered when aggregating neighbor information (message passing). To address the above limitations, we propose a learnable convolutional attention network for knowledge graph completion named LCA-KGC. LCA-KGC introduces a knowledge graph convolutional attention network using a convolution operation before the attention mechanism to ensure structural information acquisition and avoid redundant information stacking. Furthermore, to complete the autonomous switching of GNNs types and eliminate the necessity of pre-validating the local structure of KGs, LCA-KGC designs a learnable knowledge graph convolutional attention network by comprising three types of GNNs in one learnable formulation. Moreover, a learnable message function is proposed to emphasize relational semantics when aggregating neighbor information. Extensive experiments on standard KG datasets validate the effectiveness of the proposed innovations, and LCA-KGC achieves state-of-the-art (SOTA) performance compared to existing approaches (e.g., compared to SOTA approaches, LCA-KGC improves MRR from 0.360 to 0.372 on FB15k-237 dataset, and Hits@3 from 0.561 to 0.581 on YAGO3-10 dataset).

computer science, artificial intelligence
Multi-view knowledge graph fusion via knowledge-aware attentional graph neural network

Zhichao Huang,Xutao Li,Yunming Ye,Baoquan Zhang,Guangning Xu,Wensheng Gan

DOI: https://doi.org/10.1007/s10489-022-03667-1

IF: 5.3

2022-06-04

Applied Intelligence

Abstract:Knowledge graphs (KGs) play a vital role in natural language processing (NLP), which can serve several downstream tasks. Because different views of KGs are usually constructed independently, the multi-view knowledge graph fusion (MVKGF) becomes a hotspot. Although multi-view learning studied very well in past decades, MVKGF is still not well tackled because of the heterogeneous relations and the multi-view KGs. To overcome MVKGF, entity alignment is the most studied. Existing entity alignment methods are dominated by embedding based methods, such as TransE and Graph Neural Networks (GNNs), where the alignment is achieved by measuring the similarities between entity embeddings. However, most previous approaches suffer from the issues of the diverse knowledge facts and the complex neighboring structures. In this paper, we propose a novel K nowledge-aware A ttentional G raph N eural N etwork ( KAGNN ) model to carefully incorporate both knowledge facts and neighboring structures. In particular, a knowledge-aware attention mechanism is designed to preserve the original semantics and determine the importance of each knowledge fact. Furthermore, a three-layered GCN with highway gates is adopted to learn better entity representations from the neighboring structure information. Thus, our model can be regarded as a multi-view extension of GNN. We validate our model on three cross-lingual datasets and the results show our model beats the state-of-the-art baselines by a large margin.

computer science, artificial intelligence
Knowledge Graph Embedding Via Graph Attenuated Attention Networks

Rui Wang,Bicheng Li,Shengwei Hu,Wenqian Du,Min Zhang

DOI: https://doi.org/10.1109/access.2019.2963367

IF: 3.9

2019-01-01

IEEE Access

Abstract:Knowledge graphs contain a wealth of real-world knowledge that can provide strong support for artificial intelligence applications. Much progress has been made in knowledge graph completion, state-of-the-art models are based on graph convolutional neural networks. These models automatically extract features, in combination with the features of the graph model, to generate feature embeddings with a strong expressive ability. However, these methods assign the same weights on the relation path in the knowledge graph and ignore the rich information presented in neighbor nodes, which result in incomplete mining of triple features. To this end, we propose Graph Attenuated Attention networks(GAATs), a novel representation method, which integrates an attenuated attention mechanism to assign different weight in different relation path and acquire the information from the neighborhoods. As a result, entities and relations can be learned in any neighbors. Our empirical research provides insight into the effectiveness of the attenuated attention-based models, and we show significant improvement compared to the state-of-the-art methods on two benchmark datasets WN18RR and FB15k-237.
Association Rules Enhanced Knowledge Graph Attention Network

Zhenghao Zhang,Jianbin Huang,Qinglin Tan

DOI: https://doi.org/10.48550/arXiv.2011.08431

2020-11-14

Abstract:Most existing knowledge graphs suffer from incompleteness. Embedding knowledge graphs into continuous vector spaces has recently attracted increasing interest in knowledge base completion. However, in most existing embedding methods, only fact triplets are utilized, and logical rules have not been thoroughly studied for the knowledge base completion task. To overcome the problem, we propose an association rules enhanced knowledge graph attention network (AR-KGAT). The AR-KGAT captures both entity and relation features for high-order neighborhoods of any given entity in an end-to-end manner under the graph attention network framework. The major component of AR-KGAT is an encoder of an effective neighborhood aggregator, which addresses the problems by aggregating neighbors with both association-rules-based and graph-based attention weights. Additionally, the proposed model also encapsulates the representations from multi-hop neighbors of nodes to refine their embeddings. The decoder enables AR-KGAT to be translational between entities and relations while keeping the superior link prediction performance. A logic-like inference pattern is utilized as constraints for knowledge graph embedding. Then, the global loss is minimized over both atomic and complex formulas to achieve the embedding task. In this manner, we learn embeddings compatible with triplets and rules, which are certainly more predictive for knowledge acquisition and inference. We conduct extensive experiments on two benchmark datasets: WN18RR and FB15k-237, for two knowledge graph completion tasks: the link prediction and triplet classification to evaluate the proposed AR-KGAT model. The results show that the proposed AR-KGAT model achieves significant and consistent improvements over state-of-the-art methods.

Information Retrieval
Neighbor-Augmented Knowledge Graph Attention Network for Recommendation

Qi Wang,Hao Cui,Jiapeng Zhang,Yan Du,Yuan Zhou,Xiaojun Lu

DOI: https://doi.org/10.1007/s11063-023-11310-4

IF: 2.565

2023-07-03

Neural Processing Letters

Abstract:Previous knowledge graph-based recommendation models use Graph Neural Networks to aggregate information from neighbors. However, entities of the same hop should have different importance in aggregating, but this is often ignored. To overcome this problem, we try to utilize more helpful information to enhance the recommender system. This paper presents a new recommendation model: Neural Attention Network for Neighborhood Augmented Knowledge Graph (NKGAT). The model is developed based on knowledge graph and graph neural network. In the proposed model, we explore higher-order relationships using embeddings of nodes. Moreover, a new attention module (Neighbor-Augmented Attention (NAA)) is proposed. It assigns proper importance to different entities of neighbors at the same hop in the graph neural network. The experiments are carried out on Movie-Lens, Last-FM, Book-Crossing and Yelp2018 datasets. The experimental results show that NKGAT achieves state-of-the-art performance. It demonstrates that the proposed method integrates rich higher-order information with more proper attention to entities.

computer science, artificial intelligence
An attention‐based representation learning model for multiple relational knowledge graph

Zhongming Han,Fuyu Chen,Hui Zhang,Zhiyu Yang,Wenwen Liu,Zequan Shen,Haitao Xiong

DOI: https://doi.org/10.1111/exsy.13234

IF: 3.3

2023-01-23

Expert Systems

Abstract:Knowledge graph embedding models are used to learn low‐dimensional representations of entities and relations in knowledge graphs. In this paper, we propose Multi‐RAttE, an attention‐based learning method for multiple relational knowledge graph embedding representation, which divides the information transfer in the knowledge graph into cross‐relational information transfer and relation‐specific information transfer, and divides the embedding of knowledge graph entities into structural embedding and multi‐relational embedding for joint learning. To objectively analyse the performance of the Multi‐RAttE model, we select two typical datasets and different representative baseline models for experimental evaluation on several tasks such as link prediction, multi‐relation prediction and node classification. The experimental results show that the Multi‐RAttE model improves 8% over the state‐of‐the‐art model Composition‐based Multi‐Relational Graph Convolutional Networks (CompGCN) in terms of Hits@1 metric on the link prediction task on FB15k‐237 dataset; on the multi‐relation prediction task, the accuracy improves by 1.8% and 3.7% in the auc metric and F1 metric, respectively. The experimental results have proved that the Multi‐RAttE model can effectively perform the representation of multiple relations.

computer science, artificial intelligence, theory & methods

Toxins of higher fungi.

Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph Completion

Multi-relational graph attention networks for knowledge graph completion

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Hierarchical Perceptual Graph Attention Network for Knowledge Graph Completion

Hyper-node Relational Graph Attention Network for Multi-modal Knowledge Graph Completion

Relational Graph Neural Network with Hierarchical Attention for Knowledge Graph Completion

Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach

GS-InGAT: An interaction graph attention network with global semantic for knowledge graph completion

A knowledge graph completion model based on contrastive learning and relation enhancement method

r-GAT: Relational Graph Attention Network for Multi-Relational Graphs

An efficiency relation-specific graph transformation network for knowledge graph representation learning

Multi-head multi-order graph attention networks

Semantic- and relation-based graph neural network for knowledge graph completion

Learnable convolutional attention network for knowledge graph completion

Multi-view knowledge graph fusion via knowledge-aware attentional graph neural network

Knowledge Graph Embedding Via Graph Attenuated Attention Networks

Association Rules Enhanced Knowledge Graph Attention Network

Neighbor-Augmented Knowledge Graph Attention Network for Recommendation

An attention‐based representation learning model for multiple relational knowledge graph