Abstract:BackgroundBiomedical named entity recognition(BNER) is a crucial initial step of information extraction in biomedical domain. The task is typically modeled as a sequence labeling problem. Various machine learning algorithms, such as Conditional Random Fields (CRFs), have been successfully used for this task. However, these state-of-the-art BNER systems largely depend on hand-crafted features.ResultsWe present a recurrent neural network (RNN) framework based on word embeddings and character representation. On top of the neural network architecture, we use a CRF layer to jointly decode labels for the whole sentence. In our approach, contextual information from both directions and long-range dependencies in the sequence, which is useful for this task, can be well modeled by bidirectional variation and long short-term memory (LSTM) unit, respectively. Although our models use word embeddings and character embeddings as the only features, the bidirectional LSTM-RNN (BLSTM-RNN) model achieves state-of-the-art performance — 86.55% F1 on BioCreative II gene mention (GM) corpus and 73.79% F1 on JNLPBA 2004 corpus.ConclusionsOur neural network architecture can be successfully used for BNER without any manual feature engineering. Experimental results show that domain-specific pre-trained word embeddings and character-level representation can improve the performance of the LSTM-RNN models. On the GM corpus, we achieve comparable performance compared with other systems using complex hand-crafted features. Considering the JNLPBA corpus, our model achieves the best results, outperforming the previously top performing systems. The source code of our method is freely available under GPL at https://github.com/lvchen1989/BNER.

Comparing CNN and LSTM character-level embeddings in BiLSTM-CRF models for chemical and disease named entity recognition

Convolutional neural networks for chemical-disease relation extraction are improved with character-based word embeddings

Character level and word level embedding with bidirectional LSTM - Dynamic recurrent neural network for biomedical named entity recognition from literature

Biomedical Named Entity Recognition with CNN-BLSTM-CRF

Long short-term memory RNN for biomedical named entity recognition

HDCNN-CRF for Biomedical Text Named Entity Recognition

Serial and Parallel Recurrent Convolutional Neural Networks for Biomedical Named Entity Recognition

Exploring Recurrent Neural Networks To Detect Named Entities From Biomedical Text

An Attention-Based BiLSTM-CRF Approach to Document-Level Chemical Named Entity Recognition.

Integrating Language Model and Reading Control Gate in BLSTM-CRF for Biomedical Named Entity Recognition

Biomedical Named Entity Recognition Based on the Two Channels and Sentence-Level Reading Control Conditioned LSTM-CRF

A Bidirectional LSTM and Conditional Random Fields Approach to Medical Named Entity Recognition.

Using a Pre-Trained Language Model for Medical Named Entity Extraction in Chinese Clinic Text

Character-Based Deep Learning Approaches for Clinical Named Entity Recognition: A Comparative Study Using Chinese EHR Texts.

Biomedical named entity recognition based on extended Recurrent Neural Networks

SBLC: a Hybrid Model for Disease Named Entity Recognition Based on Semantic Bidirectional LSTMs and Conditional Random Fields

Biomedical Named Entity Recognition via A Hybrid Neural Network Model

A two-layer BiLSTM model with linear gating for Chinese named entity recognition

Disease Named Entity Recognition from Biomedical Literature Using a Novel Convolutional Neural Network

Language model based on deep learning network for biomedical named entity recognition

LSTM-CRF for Drug-Named Entity Recognition