Abstract:Abstract Background In biomedical text mining, named entity recognition (NER) is an important task used to extract information from biomedical articles. Previously proposed methods for NER are dictionary- or rule-based methods and machine learning approaches. However, these traditional approaches are heavily reliant on large-scale dictionaries, target-specific rules, or well-constructed corpora. These methods to NER have been superseded by the deep learning-based approach that is independent of hand-crafted features. However, although such methods of NER employ additional conditional random fields (CRF) to capture important correlations between neighboring labels, they often do not incorporate all the contextual information from text into the deep learning layers. Results We propose herein an NER system for biomedical entities by incorporating n-grams with bi-directional long short-term memory (BiLSTM) and CRF; this system is referred to as a contextual long short-term memory networks with CRF (CLSTM). We assess the CLSTM model on three corpora: the disease corpus of the National Center for Biotechnology Information (NCBI), the BioCreative II Gene Mention corpus (GM), and the BioCreative V Chemical Disease Relation corpus (CDR). Our framework was compared with several deep learning approaches, such as BiLSTM, BiLSTM with CRF, GRAM-CNN, and BERT. On the NCBI corpus, our model recorded an F-score of 85.68% for the NER of diseases, showing an improvement of 1.50% over previous methods. Moreover, although BERT used transfer learning by incorporating more than 2.5 billion words, our system showed similar performance with BERT with an F-scores of 81.44% for gene NER on the GM corpus and a outperformed F-score of 86.44% for the NER of chemicals and diseases on the CDR corpus. We conclude that our method significantly improves performance on biomedical NER tasks. Conclusion The proposed approach is robust in recognizing biological entities in text.

BioByGANS: biomedical named entity recognition by fusing contextual and syntactic features through graph attention network in node classification framework

Improving Biomedical Named Entity Recognition with a Unified Multi-Task MRC Framework

Biomedical named entity recognition with the combined feature attention and fully-shared multi-task learning

Language model based on deep learning network for biomedical named entity recognition

Research on Named Entity Recognition from Biomedical Literature

Biomedical named entity recognition using BERT in the machine reading comprehension framework

Cross-type Biomedical Named Entity Recognition with Deep Multi-Task Learning

Empowering Biomedical Named Entity Recognition Through Multi-Tagger Collaboration

Biomedical named entity recognition using deep neural networks with contextual information

Online biomedical named entities recognition by data and knowledge-driven model

BioEGRE: a linguistic topology enhanced method for biomedical relation extraction based on BioELECTRA and graph pointer neural network

A dictionary-guided attention network for biomedical named entity recognition in Chinese electronic medical records

A BIGRU-Based Stacked Attention Network for Biomedical Named Entity Recognition with Chinese EMRs

Long short-term memory RNN for biomedical named entity recognition

Towards Bootstrapping Biomedical Named Entity Recognition Using Reinforcement Learning

CollaboNet: collaboration of deep neural networks for biomedical named entity recognition

A hybrid deep-learning approach for complex biochemical named entity recognition

Integrating Language Model and Reading Control Gate in BLSTM-CRF for Biomedical Named Entity Recognition

Hierarchical shared transfer learning for biomedical named entity recognition

AIONER: All-in-one scheme-based biomedical named entity recognition using deep learning

Biomedical named entity recognition based on multi-cross attention feature fusion