Abstract:In recent time, lexicon-based LSTM and pre-training language models are combined to explore the Chinese Named Entity Recognition (NER) and achieve the current state-of-the-art (SOTA) performance on several Chinese benchmark datasets. However, existing lexicon-based models only conform lexicon features through shallow and randomly initialized coding layers and do not integrate them into the bottom layer of the pre-training language model to mine the deep lexicon knowledge. To address the above issue, we propose a novel BERT-based Enhanced Lexicon Adapter (BLA) model that fuses external lexicon feature into the pre-training language model BERT in-depth. Specifically, the external lexicon knowledge is integrated into the deep Transformer layers of BERT by the lexicon adapter mechanism. With the comparison of existing methods, our model achieves the genuine deep fusion of the lexicon knowledge and BERT representation, effectively obtaining entity boundaries and word information.Besides, given the value of high-level global semantic features in alleviating word ambiguity and segmenting precisely the entity boundary in Chinese NER, transforming the sequence labeling task into sequence generation task provides the new cogitation for extracting global semantic features. Therefore, we explore the strategies of local lexicon information's fusion and global semantic features extraction for entity category labeling. Specifically, we utilize the sequence-to-sequence (Seq2Seq) framework with pointer network as the prominent model architecture, in which the pointing function implements a custom attention mechanism and models different interactions between the source text and the semantic embedding by the generated probability . Furthermore, the decoder with the pointer mechanism generates the target sequence autoregressively. Experiments on several different benchmark Chinese datasets indicate that the proposed model achieves remarkable improvement compared with the current lexicon-based methods, and the results significantly outperform the current SOTA models.

End to End Chinese Lexical Fusion Recognition with Sememe Knowledge

Incorporating Chinese Characters of Words for Lexical Sememe Prediction

MSFM: Multi-view Semantic Feature Fusion Model for Chinese Named Entity Recognition.

A Local Information Perception Enhancement–Based Method for Chinese NER

Chinese Lexical Sememe Prediction Using CilinE Knowledge

Modeling Semantic Compositionality With Sememe Knowledge

Incorporating Knowledge for Joint Chinese Word Segmentation and Part-of-speech Tagging with SynSemGCN

Bridging the Emotional Semantic Gap via Multimodal Relevance Estimation

SememeASR: Boosting Performance of End-to-End Speech Recognition against Domain and Long-Tailed Data Shift with Sememe Semantic Knowledge

Lexical Sememe Prediction Via Word Embeddings and Matrix Factorization.

Chinese Sentence Semantic Matching Based on Multi-Granularity Fusion Model

Towards Building a Multilingual Sememe Knowledge Base: Predicting Sememes for BabelNet Synsets

Multi-level semantic fusion network for Chinese medical named entity recognition

Cross-lingual Lexical Sememe Prediction

Predicting Categorial Sememe for English-Chinese Word Pairs via Representations in Explainable Sememe Space.

Unified Lattice Graph Fusion for Chinese Named Entity Recognition

The interactive fusion of characters and lexical information for Chinese named entity recognition

Chinese Semantic Matching with Multi-granularity Alignment and Feature Fusion

Chinese Named Entity Recognition Augmented with Lexicon Memory

Sememe Prediction: Learning Semantic Knowledge from Unstructured Textual Wiki Descriptions.

Lexicon enhanced Chinese named entity recognition with pointer network