Chinese NER by Span-Level Self-Attention.

Xiaoyu Dong,Xin,Ping Guo
DOI: https://doi.org/10.1109/cis.2019.00023
2019-01-01
Abstract:In this paper, we investigate how to improve Chinese named entity recognition (NER) by applying self-attention mechanism on span-level semantic representations. Specifically, we propose a model which acquires character representations through pre-trained BERT, then extracts features of each possible character-span through LSTM, estimates the semantic reference value of each span, then explicitly leverages span-level information by performing self-attention calculation among span representations. Experiments on OntoNotes 4.0 dataset have demonstrated that the proposed model achieves 79.97% F1-score, outperforming our baseline methods.
What problem does this paper attempt to address?