Abstract:<p>Named entity recognition (NER) of chemicals and drugs is a critical domain of information extraction in biochemical research. NER provides support for text mining in biochemical reactions, including entity relation extraction, attribute extraction, and metabolic response relationship extraction. However, the existence of complex naming characteristics in the biomedical field, such as polysemy and special characters, make the NER task very challenging. Here, we propose a hybrid deep learning approach to improve the recognition accuracy of NER. Specifically, our approach applies the Bidirectional Encoder Representations from Transformers (BERT) model to extract the underlying features of the text, learns a representation of the context of the text through Bi-directional Long Short-Term Memory (BILSTM), and incorporates the multi-head attention (MHATT) mechanism to extract chapter-level features. In this approach, the MHATT mechanism aims to improve the recognition accuracy of abbreviations to efficiently deal with the problem of inconsistency in full-text labels. Moreover, conditional random field (CRF) is used to label sequence tags because this probabilistic method does not need strict independence assumptions and can accommodate arbitrary context information. The experimental evaluation on a publicly-available dataset shows that the proposed hybrid approach achieves the best recognition performance; in particular, it substantially improves performance in recognizing abbreviations, polysemes, and low-frequency entities, compared with the state-of-the-art approaches. For instance, compared with the recognition accuracies for low-frequency entities produced by the BILSTM-CRF algorithm, those produced by the hybrid approach on two entity datasets (MULTIPLE and IDENTIFIER) have been increased by 80% and 21.69%, respectively.</p>

Rich Features Based Conditional Random Fields for Biological Named Entities Recognition

Biomedical named entities recognition using conditional random fields model

A Conditional Random Fields Approach to Biomedical Named Entity Recognition

Biomedical Named Entity Recognition Based on Deep Conditional Random Fields

A Bidirectional LSTM and Conditional Random Fields Approach to Medical Named Entity Recognition.

Exploiting the Contextual Cues for Bio-Entity Name Recognition in Biomedical Literature

Incorporating rich background knowledge for gene named entity classification and recognition

Recognizing Biomedical Named Entities Using Skip-Chain Conditional Random Fields.

Recognizing Irregular Entities in Biomedical Text Via Deep Neural Networks

SBLC: a Hybrid Model for Disease Named Entity Recognition Based on Semantic Bidirectional LSTMs and Conditional Random Fields

Bio-entity Recognition Based on Combination of Conditional Random Fields and Contextual Cues

Long short-term memory RNN for biomedical named entity recognition

Named Entity Recognition from Biomedical Texts Using a Fusion Attention-Based BiLSTM-CRF.

Biomedical Named Entity Recognition Using Generalized Expectation Criteria

Biomedical Named Entity Recognition Based on Skip-Chain CRFS

A hybrid deep-learning approach for complex biochemical named entity recognition

Brief Communication: Two-phase biomedical named entity recognition using CRFs

Biomedical named entity recognition based on fusion multi-features embedding

Language model based on deep learning network for biomedical named entity recognition

Disease Named Entity Recognition by Combining Conditional Random Fields and Bidirectional Recurrent Neural Networks.

A CRFs-Based Approach Empowered with Word Representation Features to Learning Biomedical Named Entities from Medical Text.