Abstract:Abstract With rapid development of the Internet, people have undergone tremendous changes in the way they obtain information. In recent years, knowledge graph is becoming a popular tool for the public to acquire knowledge. For knowledge graph of Chinese history and culture, most researchers adopted traditional named entity recognition methods to extract entity information from unstructured historical text data. However, the traditional named entity recognition method has certain defects, and it is easy to ignore the association between entities. To extract entities from a large amount of historical and cultural information more accurately and efficiently, this paper proposes one named entity recognition model combining Bidirectional Encoder Representations from Transformers and Bidirectional Long Short-Term Memory-Conditional Random Field (BERT-BiLSTM-CRF). First, a BERT pre-trained language model is used to encode a single character to obtain a vector representation corresponding to each character. Then one Bidirectional Long Short-Term Memory (BiLSTM) layer is applied to semantically encode the input text. Finally, the label with the highest probability is output through the Conditional Random Field (CRF) layer to obtain each character’s category. This model uses the Bidirectional Encoder Representations from Transformers (BERT) pre-trained language model to replace the static word vectors trained in the traditional way. In comparison, the BERT pre-trained language model can dynamically generate semantic vectors according to the context of words, which improves the representation ability of word vectors. The experimental results prove that the model proposed in this paper has achieved excellent results in the task of named entity recognition in the field of historical culture. Compared with the existing named entity identification methods, the precision rate, recall rate, and $$F_1$$ F 1 value have been significantly improved.

A Named Entity Recognition Method for Cigarette Production Process Standard Based on BERT-BiLSTM-CRF Model

Named Entity Recognition in Industrial Processes

RETRACTED: an Entity Relationship Extraction Model Based on BERT-BLSTM-CRF for Food Safety Domain (retracted Article)

A Novel Named Entity Recognition Algorithm for Hot Strip Rolling Based on BERT-Imseq2seq-CRF Model

“FabNER”: information extraction from manufacturing process science domain literature using named entity recognition

Cigarette tasting Chinese text classification for low-resource scenarios

Drug Specification Named Entity Recognition Base on BiLSTM-CRF Model

A Method of Chinese Named Entity Recognition Based on CNN-BILSTM-CRF Model.

Named Entity Recognition of Electronic Medical Records based on BERT-BiLSTM-Biaffine Model

Improve on Entity Recognition Method Based on BiLSTM-CRF Model for the Nuclear Technology Knowledge Graph

Legal Text Recognition Using LSTM-CRF Deep Learning Model

DABC: A Named Entity Recognition Method Incorporating Attention Mechanisms

A Named Entity Recognition Approach for Electronic Medical Records Using BERT Semantic Enhancement and BiLSTM

Named Entity Recognition in Equipment Support Field Using Tri-Training Algorithm and Text Information Extraction Technology

Chinese Named Entity Recognition Method in History and Culture Field Based on BERT

BERT Named Entity Recognition with Self-attention Mechanism

Intelligent Method for Name Entity Recognition from Biomedical Text

Named Entity Recognition of Design Specification Integrated with High-Quality Topic and Attention Mechanism

Research on medical named entity recognition based on DB-MA-BiLSTM-CRF

Named Entity Recognition of Medical Examination Reports Based on BiLSTM+CRF Model