A Contrastive Knowledge Graph Embedding Model with Hierarchical Attention and Dynamic Completion

Bin Shang,Yinliang Zhao,Jun Liu,Yifan Liu,Chenxin Wang
DOI: https://doi.org/10.1007/s00521-023-08514-z
2023-01-01
Neural Computing and Applications
Abstract:Recently, multi-head Graph Attention Networks (GATs) have achieved satisfactory performance in Knowledge Graph Embedding (KGE) tasks by imposing attention mechanism in local information. However, existing GATs based KGE approaches update entities with few neighbors is difficult to obtain structured semantic information, and these methods only use relations to model the local pairwise importance of entities, which result in missing semantic information of entity embedding. Meanwhile, different entities may have the same position in vector space, which result in poor performance of the model. To this end, we propose a contrastive knowledge graph embedding model named HADC with hierarchical attention network and dynamic completion. HADC dynamically adds the neighbors of entities to complement its local structural information, incorporates both entities' and relations' importance in any given entity's neighborhood, and proposes a contrastive learning-based loss function to distinguish the position of positive and negative samples in vector space. Different experiments on three standard datasets confirm the effectiveness of our innovations, and the performance of our proposed HADC is significantly improved compared to the state-of-the-art methods.
What problem does this paper attempt to address?