Abstract:Abstract With rapid development of the Internet, people have undergone tremendous changes in the way they obtain information. In recent years, knowledge graph is becoming a popular tool for the public to acquire knowledge. For knowledge graph of Chinese history and culture, most researchers adopted traditional named entity recognition methods to extract entity information from unstructured historical text data. However, the traditional named entity recognition method has certain defects, and it is easy to ignore the association between entities. To extract entities from a large amount of historical and cultural information more accurately and efficiently, this paper proposes one named entity recognition model combining Bidirectional Encoder Representations from Transformers and Bidirectional Long Short-Term Memory-Conditional Random Field (BERT-BiLSTM-CRF). First, a BERT pre-trained language model is used to encode a single character to obtain a vector representation corresponding to each character. Then one Bidirectional Long Short-Term Memory (BiLSTM) layer is applied to semantically encode the input text. Finally, the label with the highest probability is output through the Conditional Random Field (CRF) layer to obtain each character’s category. This model uses the Bidirectional Encoder Representations from Transformers (BERT) pre-trained language model to replace the static word vectors trained in the traditional way. In comparison, the BERT pre-trained language model can dynamically generate semantic vectors according to the context of words, which improves the representation ability of word vectors. The experimental results prove that the model proposed in this paper has achieved excellent results in the task of named entity recognition in the field of historical culture. Compared with the existing named entity identification methods, the precision rate, recall rate, and $$F_1$$ F 1 value have been significantly improved.

Named Entity Recognition in Industrial Processes

Automatically Building Large-Scale Named Entity Recognition Corpora from Chinese Wikipedia

Chinese named entity recognition: The state of the art

“FabNER”: information extraction from manufacturing process science domain literature using named entity recognition

A Chinese Named Entity Recognition System with Neural Networks

Named Entity Recognition in Equipment Support Field Using Tri-Training Algorithm and Text Information Extraction Technology

Named Entity Recognition by Using XLNet-BiLSTM-CRF

A Novel Named Entity Recognition Algorithm for Hot Strip Rolling Based on BERT-Imseq2seq-CRF Model

Research on Named Entity Recognition from Biomedical Literature

A Residual BiLSTM Model for Named Entity Recognition

Chinese Named Entity Recognition Method in History and Culture Field Based on BERT

Named entity recognition of rice genes and phenotypes based on BiGRU neural networks

Long short-term memory RNN for biomedical named entity recognition

A Method of Chinese Named Entity Recognition Based on CNN-BILSTM-CRF Model.

Named entity recognition model based on Multi‐BiLSTM and competition mechanism

A Named Entity Recognition Method for Cigarette Production Process Standard Based on BERT-BiLSTM-CRF Model

A Hybrid Approach for Named Entity Recognition in Chinese Electronic Medical Record

Recognizing Chinese Judicial Named Entity using BiLSTM-CRF

An Attention-Based BiLSTM-CRF Approach to Document-Level Chemical Named Entity Recognition.

Chinese Named Entity Recognition with a Multi-Phase Model