Abstract:Abstract Background In biomedical text mining, named entity recognition (NER) is an important task used to extract information from biomedical articles. Previously proposed methods for NER are dictionary- or rule-based methods and machine learning approaches. However, these traditional approaches are heavily reliant on large-scale dictionaries, target-specific rules, or well-constructed corpora. These methods to NER have been superseded by the deep learning-based approach that is independent of hand-crafted features. However, although such methods of NER employ additional conditional random fields (CRF) to capture important correlations between neighboring labels, they often do not incorporate all the contextual information from text into the deep learning layers. Results We propose herein an NER system for biomedical entities by incorporating n-grams with bi-directional long short-term memory (BiLSTM) and CRF; this system is referred to as a contextual long short-term memory networks with CRF (CLSTM). We assess the CLSTM model on three corpora: the disease corpus of the National Center for Biotechnology Information (NCBI), the BioCreative II Gene Mention corpus (GM), and the BioCreative V Chemical Disease Relation corpus (CDR). Our framework was compared with several deep learning approaches, such as BiLSTM, BiLSTM with CRF, GRAM-CNN, and BERT. On the NCBI corpus, our model recorded an F-score of 85.68% for the NER of diseases, showing an improvement of 1.50% over previous methods. Moreover, although BERT used transfer learning by incorporating more than 2.5 billion words, our system showed similar performance with BERT with an F-scores of 81.44% for gene NER on the GM corpus and a outperformed F-score of 86.44% for the NER of chemicals and diseases on the CDR corpus. We conclude that our method significantly improves performance on biomedical NER tasks. Conclusion The proposed approach is robust in recognizing biological entities in text.

GRU-SCANET: Unleashing the Power of GRU-based Sinusoidal CApture Network for Precision-driven Named Entity Recognition

A BIGRU-Based Stacked Attention Network for Biomedical Named Entity Recognition with Chinese EMRs

A Multichannel Biomedical Named Entity Recognition Model Based on Multitask Learning and Contextualized Word Representations

Long short-term memory RNN for biomedical named entity recognition

Named Entity Recognition from Biomedical Texts Using a Fusion Attention-Based BiLSTM-CRF.

Biomedical Named Entity Recognition via A Hybrid Neural Network Model

BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition

Biomedical Named Entity Recognition at Scale

Integrating Language Model and Reading Control Gate in BLSTM-CRF for Biomedical Named Entity Recognition

MMBERT: a unified framework for biomedical named entity recognition

Biomedical named entity recognition using BERT in the machine reading comprehension framework

Self-attention-based BiGRU and capsule network for named entity recognition

Multi-level biomedical NER through multi-granularity embeddings and enhanced labeling

Biomedical named entity recognition using deep neural networks with contextual information

Language model based on deep learning network for biomedical named entity recognition

Biomedical Named Entity Recognition with CNN-BLSTM-CRF

Exploring Named Entity Recognition Via MacBERT-BiGRU and Global Pointer with Self-Attention

Brief Communication: Two-phase biomedical named entity recognition using CRFs

Online biomedical named entities recognition by data and knowledge-driven model

A two-layer BiLSTM model with linear gating for Chinese named entity recognition