Abstract:Background: Biomedical named entity recognition (Bio-NER) is a challenging problem because, in general, biomedical named entities of the same category (e.g., proteins and genes) do not follow one standard nomenclature. They have many irregularities and sometimes appear in ambiguous contexts. In recent years, machine-learning (ML) approaches have become increasingly common and now represent the cutting edge of Bio-NER technology. This paper addresses three problems faced by ML-based Bio-NER systems. First, most ML approaches usually employ singleton features that comprise one linguistic property (e.g., the current word is capitalized) and at least one class tag (e.g., B-protein, the beginning of a protein name). However, such features may be insufficient in cases where multiple properties must be considered. Adding conjunction features that contain multiple properties can be beneficial, but it would be infeasible to include all conjunction features in an NER model since memory resources are limited and some features are ineffective. To resolve the problem, we use a sequential forward search algorithm to select an effective set of features. Second, variations in the numerical parts of biomedical terms (e.g., "2" in the biomedical term IL2) cause data sparseness and generate many redundant features. In this case, we apply numerical normalization, which solves the problem by replacing all numerals in a term with one representative numeral to help classify named entities. Third, the assignment of NE tags does not depend solely on the target word's closest neighbors, but may depend on words outside the context window (e.g., a context window of five consists of the current word plus two preceding and two subsequent words). We use global patterns generated by the Smith-Waterman local alignment algorithm to identify such structures and modify the results of our ML-based tagger. This is called pattern-based post-processing. Results: To develop our ML-based Bio-NER system, we employ conditional random fields, which have performed effectively in several well-known tasks, as our underlying ML model. Adding selected conjunction features, applying numerical normalization, and employing pattern-based post-processing improve the F-scores by 1.67%, 1.04%, and 0.57%, respectively. The combined increase of 3.28% yields a total score of 72.98%, which is better than the baseline system that only uses singleton features. Conclusion: We demonstrate the benefits of using the sequential forward search algorithm to select effective conjunction feature groups. In addition, we show that numerical normalization can effectively reduce the number of redundant and unseen features. Furthermore, the Smith-Waterman local alignment algorithm can help ML-based Bio-NER deal with difficult cases that need longer context windows.

Research on Named Entity Recognition from Biomedical Literature

Biomedical named entity recognition using BERT in the machine reading comprehension framework

Improving Biomedical Named Entity Recognition with a Unified Multi-Task MRC Framework

A BERT-Based Named Entity Recognition Method of Warm Disease in Traditional Chinese Medicine

Named Entity Recognition and Relation Detection for Biomedical Information Extraction

MMBERT: a unified framework for biomedical named entity recognition

BioMNER: A Dataset for Biomedical Method Entity Recognition

NERO: a biomedical named-entity (recognition) ontology with a large, annotated corpus reveals meaningful associations through text embedding

Biomedical named entity recognition with the combined feature attention and fully-shared multi-task learning

DMNER: Biomedical Entity Recognition by Detection and Matching

Recognising Biomedical Names: Challenges and Solutions

NERBio: using selected word conjunctions, term normalization, and global patterns to improve biomedical named entity recognition

Improving the recall of biomedical named entity recognition with label re-correction and knowledge distillation

Evolution and emerging trends of named entity recognition: Bibliometric analysis from 2000 to 2023

Long short-term memory RNN for biomedical named entity recognition

Knowledge-enhanced biomedical named entity recognition and normalization: application to proteins and genes

Extrinsic Factors Affecting the Accuracy of Biomedical NER

Online biomedical named entities recognition by data and knowledge-driven model

Language model based on deep learning network for biomedical named entity recognition

Accurate Medical Named Entity Recognition Through Specialized NLP Models