Abstract:Abstract With rapid development of the Internet, people have undergone tremendous changes in the way they obtain information. In recent years, knowledge graph is becoming a popular tool for the public to acquire knowledge. For knowledge graph of Chinese history and culture, most researchers adopted traditional named entity recognition methods to extract entity information from unstructured historical text data. However, the traditional named entity recognition method has certain defects, and it is easy to ignore the association between entities. To extract entities from a large amount of historical and cultural information more accurately and efficiently, this paper proposes one named entity recognition model combining Bidirectional Encoder Representations from Transformers and Bidirectional Long Short-Term Memory-Conditional Random Field (BERT-BiLSTM-CRF). First, a BERT pre-trained language model is used to encode a single character to obtain a vector representation corresponding to each character. Then one Bidirectional Long Short-Term Memory (BiLSTM) layer is applied to semantically encode the input text. Finally, the label with the highest probability is output through the Conditional Random Field (CRF) layer to obtain each character’s category. This model uses the Bidirectional Encoder Representations from Transformers (BERT) pre-trained language model to replace the static word vectors trained in the traditional way. In comparison, the BERT pre-trained language model can dynamically generate semantic vectors according to the context of words, which improves the representation ability of word vectors. The experimental results prove that the model proposed in this paper has achieved excellent results in the task of named entity recognition in the field of historical culture. Compared with the existing named entity identification methods, the precision rate, recall rate, and $$F_1$$ F 1 value have been significantly improved.

Chinese Named Entity Recognition with Bert

Chinese Named Entity Recognition Method in History and Culture Field Based on BERT

Using Chinese Glyphs for Named Entity Recognition

BERT Named Entity Recognition with Self-attention Mechanism

Chinese named entity recognition: The state of the art

Enhanced Chinese named entity recognition with multi-granularity BERT adapter and efficient global pointer

Chinese Named Entity Recognition and Word Segmentation Based on Character.

MMBERT: a unified framework for biomedical named entity recognition

Chinese Named Entity Recognition with a Multi-Phase Model

Chinese named entity recognition via word boundary based character embedding

A Model for Chinese Named Entity Recognition Based on Global Pointer and Adversarial Learning

A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis

A Local Information Perception Enhancement–Based Method for Chinese NER

A Chinese BERT-Based Dual-Channel Named Entity Recognition Method for Solid Rocket Engines

A BERT based Chinese Named Entity Recognition method on ASEAN News

Referent graph embedding model for name entity recognition of Chinese car reviews

A hybrid Transformer approach for Chinese NER with features augmentation

DBM-CNER: A Dual-Branch Multifeature Model for Chinese Named Entity Recognition.

Chinese character relationship extraction based on BERT and CNN-BiGRU-ATT

Towards Lingua Franca Named Entity Recognition with BERT