Abstract:In recent time, lexicon-based LSTM and pre-training language models are combined to explore the Chinese Named Entity Recognition (NER) and achieve the current state-of-the-art (SOTA) performance on several Chinese benchmark datasets. However, existing lexicon-based models only conform lexicon features through shallow and randomly initialized coding layers and do not integrate them into the bottom layer of the pre-training language model to mine the deep lexicon knowledge. To address the above issue, we propose a novel BERT-based Enhanced Lexicon Adapter (BLA) model that fuses external lexicon feature into the pre-training language model BERT in-depth. Specifically, the external lexicon knowledge is integrated into the deep Transformer layers of BERT by the lexicon adapter mechanism. With the comparison of existing methods, our model achieves the genuine deep fusion of the lexicon knowledge and BERT representation, effectively obtaining entity boundaries and word information.Besides, given the value of high-level global semantic features in alleviating word ambiguity and segmenting precisely the entity boundary in Chinese NER, transforming the sequence labeling task into sequence generation task provides the new cogitation for extracting global semantic features. Therefore, we explore the strategies of local lexicon information's fusion and global semantic features extraction for entity category labeling. Specifically, we utilize the sequence-to-sequence (Seq2Seq) framework with pointer network as the prominent model architecture, in which the pointing function implements a custom attention mechanism and models different interactions between the source text and the semantic embedding by the generated probability . Furthermore, the decoder with the pointer mechanism generates the target sequence autoregressively. Experiments on several different benchmark Chinese datasets indicate that the proposed model achieves remarkable improvement compared with the current lexicon-based methods, and the results significantly outperform the current SOTA models.

Named Entity Recognition for Fusion Bridge Generation Strategies

Bridge inspection named entity recognition via BERT and lexicon augmented machine reading comprehension neural model

Research on Named Entity Recognition Based on Model Fusion

Semi-Supervised Disentangled Framework for Transferable Named Entity Recognition

MFE-transformer: Adaptive English text named entity recognition method based on multi-feature extraction and transformer

Incorporating Entity Type-Aware and Word–Word Relation-Aware Attention in Generative Named Entity Recognition

Lexicon enhanced Chinese named entity recognition with pointer network

Neural Adaptation Layers for Cross-domain Named Entity Recognition

FlexNER: A Flexible LSTM-CNN Stack Framework for Named Entity Recognition.

Multi-task Transformer with Relation-attention and Type-attention for Named Entity Recognition

Domain Adaptation for Named Entity Recognition in Online Media with Word Embeddings

Chinese Named Entity Recognition Fusing Lexical and Syntactic Information.

MMBERT: a unified framework for biomedical named entity recognition

Multi-Agent Classifiers Fusion Strategy for Biomedical Named Entity Recognition

Cascaded Models for Better Fine-Grained Named Entity Recognition

Entity Disambiguation via Fusion Entity Decoding

A Scholar Disambiguation Method Based on Heterogeneous Relation-Fusion and Attribute Enhancement.

A hybrid Transformer approach for Chinese NER with features augmentation

Med-BERT: A Pre-Training Framework for Medical Records Named Entity Recognition

S-NER: A Concise and Efficient Span-Based Model for Named Entity Recognition

Bridge Text and Knowledge by Learning Multi-Prototype Entity Mention Embedding