Enhancing Relational Classification Model Fusing Entity and Sentence Semantic Information

Chunji Wei,Xizhong Qin,Taiping Yuan
DOI: https://doi.org/10.1109/prml59573.2023.10348324
2023-01-01
Abstract:Relationship classification aims at mining the relationship between two entities in a sentence and is an essential basis for the information extraction task. However, traditional relationship classification methods, which only use the information of words in a sequence to predict the relationship between entities, cannot use the semantic information of entities and sentences for relationship classification. To solve these problems, this paper proposes a new model, ES-BERT: this model uses the word-to-word association in the BERT model to obtain the semantic information of entities by the positional encoding of entity pairs in a sentence. In addition, we use the rich semantic knowledge in the internal hidden layer of Bert to obtain the semantic information of the sentence, which can better help the model understand the sentence. Finally, the semantic information of entities and the semantic information of sentences in the hidden layer of BERT are fused, and the fused information is used for relationship classification. The experimental results show that the model proposed in this paper achieves an excellent F1 value of 88.87% on the SemEva1-2010 Task 8 dataset, which is better than other Bert-based Sota models.
What problem does this paper attempt to address?