Abstract:Motivation: Recognition of biomedical entities from scientific text is a critical component of natural language processing and automated information extraction platforms. Modern named entity recognition approaches rely heavily on supervised machine learning techniques, which are critically dependent on annotated training corpora. These approaches have been shown to perform well when trained and tested on the same source. However, in such scenario, the performance and evaluation of these models may be optimistic, as such models may not necessarily generalize to independent corpora, resulting in potential non-optimal entity recognition for large-scale tagging of widely diverse articles in databases such as PubMed. Results: Here we aggregated published corpora for the recognition of biomolecular entities (such as genes, RNA, proteins, variants, drugs and metabolites), identified entity class overlap and performed leave-corpus-out cross validation strategy to test the efficiency of existing models. We demonstrate that accuracies of models trained on individual corpora decrease substantially for recognition of the same biomolecular entity classes in independent corpora. This behavior is possibly due to limited generalizability of entity-class-related features captured by individual corpora (model 'overtraining') which we investigated further at the orthographic level, as well as potential annotation standard differences. We show that the combined use of multi-source training corpora results in overall more generalizable models for named entity recognition, while achieving comparable individual performance. By performing learning-curve-based power analysis we further identified that performance is often not limited by the quantity of the annotated data. Availability and implementation: Compiled primary and secondary sources of the aggregated corpora are available on: https://github.com/dterg/biomedical_corpora/wiki and https://bitbucket.org/iAnalytica/bioner. Supplementary information: Supplementary data are available at Bioinformatics online.

Named Entity Recognition in Biology Literature Based on Unsupervised Domain Adaptation Method.

Research on Named Entity Recognition from Biomedical Literature

Unsupervised Biomedical Named Entity Recognition: Experiments with Clinical and Biological Texts.

Biomedical named entity recognition using BERT in the machine reading comprehension framework

Recognising Biomedical Names: Challenges and Solutions

Ensemble pretrained language models to extract biomedical knowledge from literature

NanoNER: Named Entity Recognition for nanobiology using experts' knowledge and distant supervision

Towards Bootstrapping Biomedical Named Entity Recognition Using Reinforcement Learning

BioByGANS: biomedical named entity recognition by fusing contextual and syntactic features through graph attention network in node classification framework

Improving the recall of biomedical named entity recognition with label re-correction and knowledge distillation

BioMNER: A Dataset for Biomedical Method Entity Recognition

Named Entity Recognition and Relation Detection for Biomedical Information Extraction

Language model based on deep learning network for biomedical named entity recognition

Unified Fine-Grained Biomedical Entity Recognition As a Combination of Boundary Detection and Sequence Generation.

Adversarial Transfer Learning for Biomedical Named Entity Recognition

Exploiting and assessing multi-source data for supervised biomedical named entity recognition

Online biomedical named entities recognition by data and knowledge-driven model

Biomedical named entity recognition with the combined feature attention and fully-shared multi-task learning

Demonstration-based learning for few-shot biomedical named entity recognition under machine reading comprehension

Long short-term memory RNN for biomedical named entity recognition