Abstract:Background: Biomedical named entity recognition (Bio-NER) is a challenging problem because, in general, biomedical named entities of the same category (e.g., proteins and genes) do not follow one standard nomenclature. They have many irregularities and sometimes appear in ambiguous contexts. In recent years, machine-learning (ML) approaches have become increasingly common and now represent the cutting edge of Bio-NER technology. This paper addresses three problems faced by ML-based Bio-NER systems. First, most ML approaches usually employ singleton features that comprise one linguistic property (e.g., the current word is capitalized) and at least one class tag (e.g., B-protein, the beginning of a protein name). However, such features may be insufficient in cases where multiple properties must be considered. Adding conjunction features that contain multiple properties can be beneficial, but it would be infeasible to include all conjunction features in an NER model since memory resources are limited and some features are ineffective. To resolve the problem, we use a sequential forward search algorithm to select an effective set of features. Second, variations in the numerical parts of biomedical terms (e.g., "2" in the biomedical term IL2) cause data sparseness and generate many redundant features. In this case, we apply numerical normalization, which solves the problem by replacing all numerals in a term with one representative numeral to help classify named entities. Third, the assignment of NE tags does not depend solely on the target word's closest neighbors, but may depend on words outside the context window (e.g., a context window of five consists of the current word plus two preceding and two subsequent words). We use global patterns generated by the Smith-Waterman local alignment algorithm to identify such structures and modify the results of our ML-based tagger. This is called pattern-based post-processing. Results: To develop our ML-based Bio-NER system, we employ conditional random fields, which have performed effectively in several well-known tasks, as our underlying ML model. Adding selected conjunction features, applying numerical normalization, and employing pattern-based post-processing improve the F-scores by 1.67%, 1.04%, and 0.57%, respectively. The combined increase of 3.28% yields a total score of 72.98%, which is better than the baseline system that only uses singleton features. Conclusion: We demonstrate the benefits of using the sequential forward search algorithm to select effective conjunction feature groups. In addition, we show that numerical normalization can effectively reduce the number of redundant and unseen features. Furthermore, the Smith-Waterman local alignment algorithm can help ML-based Bio-NER deal with difficult cases that need longer context windows.

A Multi-level Disambiguation Framework for Gene Name Normalization

GeneTUKit: a Software for Document-Level Gene Normalization

A method for named entity normalization in biomedical articles: application to diseases and plants

A Unified Framework for Name Disambiguation

Robust hybrid name disambiguation framework for large databases

Knowledge-enhanced biomedical named entity recognition and normalization: application to proteins and genes

Overview of BioCreative II Gene Normalization

Disambiguation Model for Bio-Medical Named Entity Recognition

Multi-document Chinese Name Disambiguation Based on Latent Semantic Analysis

Name Disambiguation By Collective Classification

A Constraint-Based Probabilistic Framework for Name Disambiguation

A supervised and distributed framework for cold-start author disambiguation in large-scale publications

Deep Convolutional Neural Network Based Medical Concept Normalization

Biomedical Named Entity Recognition via Dictionary-based Synonym Generalization

On Graph-Based Name Disambiguation.

Recognising Biomedical Names: Challenges and Solutions

TaggerOne: joint named entity recognition and normalization with semi-Markov Models

CMCN: Chinese medical concept normalization using continual learning and knowledge-enhanced

The Gene Normalization Task in BioCreative III

NERBio: using selected word conjunctions, term normalization, and global patterns to improve biomedical named entity recognition