A Simplifying and Learnable Graph Convolutional Attention Network for Unsupervised Knowledge Graphs Alignment

Weishan Cai,Wenjun Ma,Yuncheng Jiang
2024-10-17
Abstract:The success of current Entity Alignment (EA) task depends largely on the supervision information provided by labeled data. Considering the cost of labeled data, most supervised methods are difficult to apply in practical scenarios. Therefore, more and more works based on contrastive learning, active learning or other deep learning techniques have been developed, to solve the performance bottleneck caused by the lack of labeled data. However, the existing unsupervised EA methods still have some limitations, either their modeling complexity is high or they cannot balance the effectiveness and practicality of alignment. To overcome these issues, we propose a Simplifying and Learnable graph convolutional attention network for Unsupervised Knowledge Graphs alignment method (SLU). Specifically, we first introduce LCAT, a new and simple framework as the backbone network to model the graph structure of two KGs. Then we design a reconstruction method of relation structure based on potential matching relations for efficiently filtering invalid neighborhood information of aligned entities, to improve the usability and scalability of SLU. Impressively, a similarity function based on consistency is proposed to better measure the similarity of candidate entity pairs. Finally, we conduct extensive experiments on three datasets of different sizes (15K and 100K) and different types (cross-lingual and monolingual) to verify the superiority of SLU. Experimental results show that SLU significantly improves alignment accuracy, outperforming 25 supervised or unsupervised methods, and improving 6.4% in Hits@1 over the best baseline in the best case.
Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
This paper attempts to solve several key problems in the entity alignment (EA) task, especially in an unsupervised environment: 1. **Dependence on Labeled Data**: Most current EA methods rely on the supervision information provided by labeled data. However, the high cost of labeled data makes these supervised methods difficult to be widely applied in practical scenarios. 2. **Limitations of Existing Unsupervised EA Methods**: - High model complexity: Many methods use complex models, such as various variants of GNN or stacking multiple GNNs, in order to better capture the neighborhood similarity of aligned entities, which leads to increased model complexity and low training efficiency. - The balance between effectiveness and practicality: Some existing unsupervised EA methods cannot well balance the effectiveness and practicality of alignment. To solve these problems, the author proposes a Simplifying and Learnable graph convolutional attention network for Unsupervised Knowledge Graphs alignment method (abbreviated as SLU). Specifically, SLU aims to improve the entity alignment task in the following ways: - **Introducing LCAT as the Backbone Network**: LCAT is a new and simple GNN framework for modeling the graph structures of two knowledge graphs (KGs). Compared with traditional GCN and GAT, LCAT has higher robustness and modeling efficiency. - **A Relation Structure Reconstruction Method Based on Latent Matching Relations**: In order to efficiently filter out the invalid neighborhood information of aligned entities, SLU designs a relation structure reconstruction method based on latent matching relations. This method can reduce the invalid data input to the model, thereby improving the practicality and extensibility of the model. - **Contrastive Learning**: SLU introduces contrastive learning to eliminate the dependence on alignment seeds, making the method more suitable for practical scenarios. - **A Consistency - Based Similarity Function**: A new consistency - based similarity function is proposed to better measure the similarity of candidate entity pairs. Through these improvements, SLU has been extensively experimented on three datasets of different scales and types. The results show that SLU significantly improves the alignment accuracy, outperforms 25 supervised or unsupervised methods, and in the best case, improves the Hits@1 metric by 6.4%. ### Summary The main contributions of this paper are: - Proposing a new relation structure reconstruction method, which improves the alignment accuracy and reduces the amount of model training. - Introducing LCAT, a simplified and learnable GNN model, which improves the robustness and modeling efficiency of entity feature learning. - Proposing a consistency - based similarity function to better measure the similarity of candidate entity pairs. - The experimental results show that SLU not only significantly outperforms the existing 25 state - of - the - art models, but also shows impressive extensibility and robustness. These improvements make SLU more useful and robust in the unsupervised entity alignment task and suitable for practical application scenarios.