Abstract:In recent time, lexicon-based LSTM and pre-training language models are combined to explore the Chinese Named Entity Recognition (NER) and achieve the current state-of-the-art (SOTA) performance on several Chinese benchmark datasets. However, existing lexicon-based models only conform lexicon features through shallow and randomly initialized coding layers and do not integrate them into the bottom layer of the pre-training language model to mine the deep lexicon knowledge. To address the above issue, we propose a novel BERT-based Enhanced Lexicon Adapter (BLA) model that fuses external lexicon feature into the pre-training language model BERT in-depth. Specifically, the external lexicon knowledge is integrated into the deep Transformer layers of BERT by the lexicon adapter mechanism. With the comparison of existing methods, our model achieves the genuine deep fusion of the lexicon knowledge and BERT representation, effectively obtaining entity boundaries and word information.Besides, given the value of high-level global semantic features in alleviating word ambiguity and segmenting precisely the entity boundary in Chinese NER, transforming the sequence labeling task into sequence generation task provides the new cogitation for extracting global semantic features. Therefore, we explore the strategies of local lexicon information's fusion and global semantic features extraction for entity category labeling. Specifically, we utilize the sequence-to-sequence (Seq2Seq) framework with pointer network as the prominent model architecture, in which the pointing function implements a custom attention mechanism and models different interactions between the source text and the semantic embedding by the generated probability . Furthermore, the decoder with the pointer mechanism generates the target sequence autoregressively. Experiments on several different benchmark Chinese datasets indicate that the proposed model achieves remarkable improvement compared with the current lexicon-based methods, and the results significantly outperform the current SOTA models.

A RoBERTa-GlobalPointer-Based Method for Named Entity Recognition of Legal Documents.

Named Entity Recognition in the Legal Domain using a Pointer Generator Network

Exploiting global contextual information for document-level named entity recognition

Legal Text Recognition Using LSTM-CRF Deep Learning Model

Recognizing Chinese Judicial Named Entity using BiLSTM-CRF

Joint extraction of Chinese medical entities and relations based on RoBERTa and single-module global pointer

A Local Information Perception Enhancement–Based Method for Chinese NER

A Model for Chinese Named Entity Recognition Based on Global Pointer and Adversarial Learning

Enhanced Chinese named entity recognition with multi-granularity BERT adapter and efficient global pointer

Named entity recognition for Chinese based on global pointer and adversarial training

Understand Legal Documents with Contextualized Large Language Models

A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis

Named Entity Recognition Method of Legal Instruments Based on Improved Few-Shot Learning

Attentive Deep Neural Networks for Legal Document Retrieval

Cross-Lingual Named Entity Recognition Using Parallel Corpus: A New Approach Using XLM-RoBERTa Alignment

Combining prompt-based language models and weak supervision for labeling named entity recognition on legal documents

A Hierarchical Neural Framework for Classification and its Explanation in Large Unstructured Legal Documents

Lexicon enhanced Chinese named entity recognition with pointer network

DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment

An Attention-Based BiLSTM-CRF Approach to Document-Level Chemical Named Entity Recognition.

BERT_LF: A Similar Case Retrieval Method Based on Legal Facts