Coreference Resolution Based on High-Dimensional Multi-Scale Information
Yu Wang,Zenghui Ding,Tao Wang,Shu Xu,Xianjun Yang,Yining Sun
DOI: https://doi.org/10.3390/e26060529
IF: 2.738
2024-06-20
Entropy
Abstract:Coreference resolution is a key task in Natural Language Processing. It is difficult to evaluate the similarity of long-span texts, which makes text-level encoding somewhat challenging. This paper first compares the impact of commonly used methods to improve the global information collection ability of the model on the BERT encoding performance. Based on this, a multi-scale context information module is designed to improve the applicability of the BERT encoding model under different text spans. In addition, improving linear separability through dimension expansion. Finally, cross-entropy loss is used as the loss function. After adding BERT and span BERT to the module designed in this article, F1 increased by 0.5% and 0.2%, respectively.
physics, multidisciplinary