Dependency-position relation graph convolutional network with hierarchical attention mechanism for relation extraction
Nan Li,Ying Wang,Tianxu Liu
DOI: https://doi.org/10.1007/s11227-024-06204-8
IF: 3.3
2024-05-26
The Journal of Supercomputing
Abstract:Existing research extensively incorporates syntactic information, especially dependency trees, to enhance the performance of relation extraction tasks. However, relying solely on dependency information may not fully exploit the rich semantic and syntactic information contained in sentences, and not all information in dependency trees is substantively helpful for relation extraction. Therefore, this paper proposes the Dependent-Position Relation Graph Convolutional network with Hierarchical Attention (DPR-GHA) for relation extraction, a method that integrates dependency relations and position relations into a hierarchical attention mechanism to effectively capture the relations between entities in text. The method aims to capture rich semantic information and enhance the performance of relation extraction. Specifically, we introduce the dependency relations of sentences and position relations of words to model global dependencies and local features, respectively. Subsequently, a novel hierarchical attention mechanism is introduced into the Graph Convolutional Network (GCN), dynamically adjusting the weights between nodes based on the input of the graph convolutional layer. This adaptive information aggregation enables each node to aggregate information adaptively according to its context and the importance of neighboring nodes. The research results on the SemEval-2010 Task 8 and KBP37 datasets thoroughly validate the effectiveness of the proposed model, demonstrating its significant performance advantage in relation extraction tasks.
computer science, theory & methods,engineering, electrical & electronic, hardware & architecture