Abstract:Abstract Background In biomedical text mining, named entity recognition (NER) is an important task used to extract information from biomedical articles. Previously proposed methods for NER are dictionary- or rule-based methods and machine learning approaches. However, these traditional approaches are heavily reliant on large-scale dictionaries, target-specific rules, or well-constructed corpora. These methods to NER have been superseded by the deep learning-based approach that is independent of hand-crafted features. However, although such methods of NER employ additional conditional random fields (CRF) to capture important correlations between neighboring labels, they often do not incorporate all the contextual information from text into the deep learning layers. Results We propose herein an NER system for biomedical entities by incorporating n-grams with bi-directional long short-term memory (BiLSTM) and CRF; this system is referred to as a contextual long short-term memory networks with CRF (CLSTM). We assess the CLSTM model on three corpora: the disease corpus of the National Center for Biotechnology Information (NCBI), the BioCreative II Gene Mention corpus (GM), and the BioCreative V Chemical Disease Relation corpus (CDR). Our framework was compared with several deep learning approaches, such as BiLSTM, BiLSTM with CRF, GRAM-CNN, and BERT. On the NCBI corpus, our model recorded an F-score of 85.68% for the NER of diseases, showing an improvement of 1.50% over previous methods. Moreover, although BERT used transfer learning by incorporating more than 2.5 billion words, our system showed similar performance with BERT with an F-scores of 81.44% for gene NER on the GM corpus and a outperformed F-score of 86.44% for the NER of chemicals and diseases on the CDR corpus. We conclude that our method significantly improves performance on biomedical NER tasks. Conclusion The proposed approach is robust in recognizing biological entities in text.

Biomedical named entity recognition with the combined feature attention and fully-shared multi-task learning

Improving Biomedical Named Entity Recognition with a Unified Multi-Task MRC Framework

Cross-type Biomedical Named Entity Recognition with Deep Multi-Task Learning

Hierarchical shared transfer learning for biomedical named entity recognition

Dataset-aware multi-task learning approaches for biomedical named entity recognition

Language model based on deep learning network for biomedical named entity recognition

Biomedical named entity recognition using BERT in the machine reading comprehension framework

Empowering Biomedical Named Entity Recognition Through Multi-Tagger Collaboration

Biomedical named entity recognition using deep neural networks with contextual information

Research on Named Entity Recognition from Biomedical Literature

Long short-term memory RNN for biomedical named entity recognition

BioNER-CFEM: Biomedical Named Entity Recognition Based on Character Feature Enhancement with Multimodal Method

Biomedical Named Entity Recognition at Scale

A BIGRU-Based Stacked Attention Network for Biomedical Named Entity Recognition with Chinese EMRs

An Effective Biomedical Named Entity Recognition by Handling Imbalanced Data Sets Using Deep Learning and Rule-Based Methods

Adversarial Transfer Learning for Biomedical Named Entity Recognition

BioByGANS: biomedical named entity recognition by fusing contextual and syntactic features through graph attention network in node classification framework

Named entity recognition of Chinese electronic medical records based on a hybrid neural network and medical MC-BERT

MMBERT: a unified framework for biomedical named entity recognition

Analyzing the Effect of Multi-task Learning for Biomedical Named Entity Recognition

Unified Fine-Grained Biomedical Entity Recognition As a Combination of Boundary Detection and Sequence Generation.