Abstract:Motivation: The explosive increase of biomedical literature has made information extraction an increasingly important tool for biomedical research. A fundamental task is the recognition of biomedical named entities in text (BNER) such as genes/proteins, diseases and species. Recently, a domain-independent method based on deep learning and statistical word embeddings, called long short-term memory network-conditional random field (LSTM-CRF), has been shown to outperform state-of-the-art entity-specific BNER tools. However, this method is dependent on gold-standard corpora (GSCs) consisting of hand-labeled entities, which tend to be small but highly reliable. An alternative to GSCs are silver-standard corpora (SSCs), which are generated by harmonizing the annotations made by several automatic annotation systems. SSCs typically contain more noise than GSCs but have the advantage of containing many more training examples. Ideally, these corpora could be combined to achieve the benefits of both, which is an opportunity for transfer learning. In this work, we analyze to what extent transfer learning improves upon state-of-the-art results for BNER.Results: We demonstrate that transferring a deep neural network (DNN) trained on a large, noisy SSC to a smaller, but more reliable GSC significantly improves upon state-of-the-art results for BNER. Compared to a state-of-the-art baseline evaluated on 23 GSCs covering four different entity classes, transfer learning results in an average reduction in error of approximately 11%. We found transfer learning to be especially beneficial for target datasets with a small number of labels (approximately 6000 or less).Availability and implementation: Source code for the LSTM-CRF is available at https://github.com/Franck-Dernoncourt/NeuroNER/ and links to the corpora are available at https://github.com/BaderLab/Transfer-Learning-BNER-Bioinformatics-2018/.Supplementary information: Supplementary data are available at Bioinformatics online.

Biomedical Named Entity Recognition via Reference-Set Augmented Bootstrapping

A pre-training and self-training approach for biomedical named entity recognition

Improving biomedical named entity recognition through transfer learning and asymmetric tri-training

Biomedical Named Entity Recognition at Scale

Augmenting Biomedical Named Entity Recognition with General-domain Resources

Towards Bootstrapping Biomedical Named Entity Recognition Using Reinforcement Learning

NanoNER: Named Entity Recognition for nanobiology using experts' knowledge and distant supervision

Long short-term memory RNN for biomedical named entity recognition

Recognising Biomedical Names: Challenges and Solutions

Data augmentation and transfer learning for cross-lingual Named Entity Recognition in the biomedical domain

Partial Annotation Learning for Biomedical Entity Recognition

Deep learning with word embeddings improves biomedical named entity recognition

Transfer learning for biomedical named entity recognition with neural networks

BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition

Improving the recall of biomedical named entity recognition with label re-correction and knowledge distillation

BioAug: Conditional Generation based Data Augmentation for Low-Resource Biomedical NER

Improving Multi-Word Entity Recognition for Biomedical Texts

An improved data augmentation approach and its application in medical named entity recognition

Multi-level biomedical NER through multi-granularity embeddings and enhanced labeling