A Multi-task Approach for Machine Reading Comprehension Form Named Entity Recognition Tasks

Yu Zhang,Jian Deng,Ying Ma,Jianmin Li
DOI: https://doi.org/10.2991/978-94-6463-040-4_73
2023-01-01
Abstract:Named Entity Recognition (NER) is a basic NLP task that aims to provide class labels for words in free text, such as people, locations.The traditional NER task is treated as a label-sequence task, but the trend of recent jobs is to convert the NER task into a Machine Reading Comprehension (MRC) task to achieve better representation.However, this conversion is often accompanied by the problem of poor generalization of the model due to too few class-specific instances.Therefore, to solve this problem, we try to introduce different domain knowledge into our NER task, and we introduce MRC knowledge as well as NLI knowledge into our NER task through a multi-task learning approach.Our method is a one-stage model that combines two large NLI datasets (MNLI, SNLI) and a large traditional MRC dataset (SquAD) with our target NER dataset for multi-task learning.Through multi task learning, we learn the knowledge of NLI domain and MRC domain, so as to improve the performance of our model on the target dataset.We conducted enough experiments to validate the effectiveness of our method.Also, our model achieves 0.3% and 0.106% improvement compared to different baselines, respectively, proving that introducing external knowledge is effective in improving model performance.
What problem does this paper attempt to address?