A Joint Entity-Relation Extraction Method with Sparse Parameter Sharing Architecture

Dierong Chen,Juanjuan Cai,Chuanzhen Li
DOI: https://doi.org/10.1109/iccc54389.2021.9674535
2021-12-10
Abstract:The existing parameter sharing joint entity-relation extraction models cannot learn task-specific features for named entity recognition and relation classification subtasks. To address the problem, this work proposed a sparse parameter sharing joint entity-relation extraction method. The proposed method incorporates a sparse parameter sharing architecture with the existing parameter sharing joint entity-relation extraction model SpERT to learn subnetworks for the two subtasks. The subnetworks inherit and partially share the base network parameters, which provide the implicit feature interaction learning ability and task-specific feature learning ability for the model. Experiments are conducted on the ADE, SciERC, and CoNLL04 datasets. The experimental results show that the proposed method outperforms the baseline model SpERT by up to 1.40% in the F1 value. In addition, the performance on datasets SciERC and ADE can exceed the state-of-the-art results.
What problem does this paper attempt to address?