Systematic approach to the identification of toxic organic compounds isolated from tissues and fluids. III. Aquo-ferriate and stannic chloride tests.

C. J. Umberger,A. Stolman

1952-03-01

Abstract:

What problem does this paper attempt to address?

Improving Biomedical Named Entity Recognition with a Unified Multi-Task MRC Framework

Yiqi Tong,Fuzhen Zhuang,Deqing Wang,Haochao Ying,Binling Wang

DOI: https://doi.org/10.1109/icassp43922.2022.9746482

2022-01-01

Abstract:The prior knowledge, such as expert rules and knowledge base, has been proven effective in the traditional Biomedical Named Entity Recognition (BioNER). Most current neural BioNER systems use this external knowledge for pre-processing or post-editing instead of incorporate it into the training process, which cannot be learned by the model. To encode prior knowledge into the model, we present a unified multi-task Machine Reading Comprehension (MRC) framework for BioNER. Specifically, in the MRC task, the question sequences are derived from the standard BioNER dataset. We introduce three kinds of prior knowledge at query sequences, including Wikipedia, annotation scheme, entity dictionary. Then, our model adopts a multi-task learning strategy to joint training the main task BioNER and the auxiliary task MRC. Finally, experimental results on three benchmark datasets validate the superiority of our BioNER model compared with various state-of-the-art baselines.
NERBio: using selected word conjunctions, term normalization, and global patterns to improve biomedical named entity recognition

Richard Tzong-Han Tsai,Cheng-Lung Sung,Hong-Jie Dai,Hsieh-Chuan Hung,Ting-Yi Sung,Wen-Lian Hsu

DOI: https://doi.org/10.1186/1471-2105-7-S5-S11

IF: 3.307

2006-12-18

BMC Bioinformatics

Abstract:Background: Biomedical named entity recognition (Bio-NER) is a challenging problem because, in general, biomedical named entities of the same category (e.g., proteins and genes) do not follow one standard nomenclature. They have many irregularities and sometimes appear in ambiguous contexts. In recent years, machine-learning (ML) approaches have become increasingly common and now represent the cutting edge of Bio-NER technology. This paper addresses three problems faced by ML-based Bio-NER systems. First, most ML approaches usually employ singleton features that comprise one linguistic property (e.g., the current word is capitalized) and at least one class tag (e.g., B-protein, the beginning of a protein name). However, such features may be insufficient in cases where multiple properties must be considered. Adding conjunction features that contain multiple properties can be beneficial, but it would be infeasible to include all conjunction features in an NER model since memory resources are limited and some features are ineffective. To resolve the problem, we use a sequential forward search algorithm to select an effective set of features. Second, variations in the numerical parts of biomedical terms (e.g., "2" in the biomedical term IL2) cause data sparseness and generate many redundant features. In this case, we apply numerical normalization, which solves the problem by replacing all numerals in a term with one representative numeral to help classify named entities. Third, the assignment of NE tags does not depend solely on the target word's closest neighbors, but may depend on words outside the context window (e.g., a context window of five consists of the current word plus two preceding and two subsequent words). We use global patterns generated by the Smith-Waterman local alignment algorithm to identify such structures and modify the results of our ML-based tagger. This is called pattern-based post-processing. Results: To develop our ML-based Bio-NER system, we employ conditional random fields, which have performed effectively in several well-known tasks, as our underlying ML model. Adding selected conjunction features, applying numerical normalization, and employing pattern-based post-processing improve the F-scores by 1.67%, 1.04%, and 0.57%, respectively. The combined increase of 3.28% yields a total score of 72.98%, which is better than the baseline system that only uses singleton features. Conclusion: We demonstrate the benefits of using the sequential forward search algorithm to select effective conjunction feature groups. In addition, we show that numerical normalization can effectively reduce the number of redundant and unseen features. Furthermore, the Smith-Waterman local alignment algorithm can help ML-based Bio-NER deal with difficult cases that need longer context windows.
Solid‐phase synthesis and screening of a library of C‐terminal arginine peptide aldehydes against Murray Valley encephalitis virus protease

N. Ede,Jeffrey Hill,J. Joy,Anne-Marie Ede,Merran L Koppens

DOI: https://doi.org/10.1002/psc.2450

2012-09-18

Journal of Peptide Science

Abstract:Murray Valley encephalitis virus is a member of the flavivirus group, a large family of single‐stranded RNA viruses, which cause serious disease in all regions of the world. Unfortunately, no suitable antivirals are available, and there are commercial vaccines for only three flaviviruses. The solid‐phase synthesis of a library of 400 C‐terminal arginine peptide aldehydes and their screening against Murray Valley encephalitis virus protease are demonstrated. The library was utilised to elucidate several tripeptide sequences that can be used as inhibitors in further SAR studies. Copyright © 2012 European Peptide Society and John Wiley & Sons, Ltd.
Improving the recall of biomedical named entity recognition with label re-correction and knowledge distillation

Huiwei Zhou,Zhe Liu,Chengkun Lang,Yibin Xu,Yingyu Lin,Junjie Hou

DOI: https://doi.org/10.1186/s12859-021-04200-w

IF: 3.307

2021-06-02

BMC Bioinformatics

Abstract:Abstract Background Biomedical named entity recognition is one of the most essential tasks in biomedical information extraction. Previous studies suffer from inadequate annotated datasets, especially the limited knowledge contained in them. Methods To remedy the above issue, we propose a novel Biomedical Named Entity Recognition (BioNER) framework with label re-correction and knowledge distillation strategies, which could not only create large and high-quality datasets but also obtain a high-performance recognition model. Our framework is inspired by two points: (1) named entity recognition should be considered from the perspective of both coverage and accuracy; (2) trustable annotations should be yielded by iterative correction. Firstly, for coverage, we annotate chemical and disease entities in a large-scale unlabeled dataset by PubTator to generate a weakly labeled dataset. For accuracy, we then filter it by utilizing multiple knowledge bases to generate another weakly labeled dataset. Next, the two datasets are revised by a label re-correction strategy to construct two high-quality datasets, which are used to train two recognition models, respectively. Finally, we compress the knowledge in the two models into a single recognition model with knowledge distillation. Results Experiments on the BioCreative V chemical-disease relation corpus and NCBI Disease corpus show that knowledge from large-scale datasets significantly improves the performance of BioNER, especially the recall of it, leading to new state-of-the-art results. Conclusions We propose a framework with label re-correction and knowledge distillation strategies. Comparison results show that the two perspectives of knowledge in the two re-corrected datasets respectively are complementary and both effective for BioNER.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Research on Named Entity Recognition from Biomedical Literature

张向喆,王明辉,赵洪波,王起山,潘玉春

DOI: https://doi.org/10.3969/j.issn.1671-9964.2010.02.008

2010-01-01

Abstract:Biological named entity recognition (Bio-NER) is a key technology of biomedical text processing. Precise Bio-NER tools are a prerequisite for many applications working on text, such as information extraction or document classification. Over the past years of research, NER has made some progresses in the life sciences. In this paper, the characteristics of biological named entities are described, the variant methods underlying most Bio-NER systems sketched, and a view of the future of Bio-NER given.
Improving Biomedical Named Entity Recognition with Label Re-correction and Knowledge Distillation

Huiwei Zhou,Zhe Liu,Chengkun Lang,Yingyu Lin,Junjie Hou

DOI: https://doi.org/10.21203/rs.3.rs-125685/v1

2020-12-15

Abstract:Abstract Background: Biomedical named entities recognition is one of the most essential tasks in biomedical information extraction. Previous studies suffer from inadequate annotation datasets, especially the limited knowledge contained in them. Methods: To remedy the above issue, we propose a novel Chemical and Disease Named Entity Recognition (CDNER) framework with label re-correction and knowledge distillation strategies, which could not only create large and high-quality datasets but also obtain a high-performance entity recognition model. Our framework is inspired by two points: 1) named entity recognition should be considered from the perspective of both coverage and accuracy; 2) trustable annotations should be yielded by iterative correction. Firstly, for coverage, we annotate chemical and disease entities in a large unlabeled dataset by PubTator to generate a weakly labeled dataset. For accuracy, we then filter it by utilizing multiple knowledge bases to generate another dataset. Next, the two datasets are revised by a label re-correction strategy to construct two high-quality datasets, which are used to train two CDNER models, respectively. Finally, we compress the knowledge in the two models into a single model with knowledge distillation. Results: Experiments on the BioCreative V chemical-disease relation corpus show that knowledge from large datasets significantly improves CDNER performance, leading to new state-of-the-art results. Conclusions: We propose a framework with label re-correction and knowledge distillation strategies. Comparison results show that the two perspectives of knowledge in the two re-corrected datasets respectively are complementary and both effective for biomedical named entity recognition.
Biomedical named entity recognition using deep neural networks with contextual information

Hyejin Cho,Hyunju Lee

DOI: https://doi.org/10.1186/s12859-019-3321-4

IF: 3.307

2019-12-01

BMC Bioinformatics

Abstract:Abstract Background In biomedical text mining, named entity recognition (NER) is an important task used to extract information from biomedical articles. Previously proposed methods for NER are dictionary- or rule-based methods and machine learning approaches. However, these traditional approaches are heavily reliant on large-scale dictionaries, target-specific rules, or well-constructed corpora. These methods to NER have been superseded by the deep learning-based approach that is independent of hand-crafted features. However, although such methods of NER employ additional conditional random fields (CRF) to capture important correlations between neighboring labels, they often do not incorporate all the contextual information from text into the deep learning layers. Results We propose herein an NER system for biomedical entities by incorporating n-grams with bi-directional long short-term memory (BiLSTM) and CRF; this system is referred to as a contextual long short-term memory networks with CRF (CLSTM). We assess the CLSTM model on three corpora: the disease corpus of the National Center for Biotechnology Information (NCBI), the BioCreative II Gene Mention corpus (GM), and the BioCreative V Chemical Disease Relation corpus (CDR). Our framework was compared with several deep learning approaches, such as BiLSTM, BiLSTM with CRF, GRAM-CNN, and BERT. On the NCBI corpus, our model recorded an F-score of 85.68% for the NER of diseases, showing an improvement of 1.50% over previous methods. Moreover, although BERT used transfer learning by incorporating more than 2.5 billion words, our system showed similar performance with BERT with an F-scores of 81.44% for gene NER on the GM corpus and a outperformed F-score of 86.44% for the NER of chemicals and diseases on the CDR corpus. We conclude that our method significantly improves performance on biomedical NER tasks. Conclusion The proposed approach is robust in recognizing biological entities in text.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Biomedical Entity Normalization based on Pre-trained Model with Enhanced Information.

Lu Fang,Yiling Cao,Zhongguang Zheng

2021-01-01

Abstract:Biomedical entity normalization, which links entity mentions in biomedical texts to their corresponding standard concepts in a knowledge base(KB) or an ontology is an important task in biomedical text mining. A prevalent solution is to generate the most similar concepts, and then rank those concepts with semantic models. Herein, to improve the performance of candidate concepts ranking for entity normalization, we rank the candidates by fine-tuning the domain-specific pre-trained BioBERT model and enhancing the representation information with entity mentions and candidates. We have achieved significant improvement over the state-of-the-art method on the Bacteria Biotope data of BioNLP-OST19 .
Biomedical named entity recognition using BERT in the machine reading comprehension framework

Cong Sun,Zhihao Yang,Lei Wang,Yin Zhang,Hongfei Lin,Jian Wang

DOI: https://doi.org/10.1016/j.jbi.2021.103799

Abstract:Recognition of biomedical entities from literature is a challenging research focus, which is the foundation for extracting a large amount of biomedical knowledge existing in unstructured texts into structured formats. Using the sequence labeling framework to implement biomedical named entity recognition (BioNER) is currently a conventional method. This method, however, often cannot take full advantage of the semantic information in the dataset, and the performance is not always satisfactory. In this work, instead of treating the BioNER task as a sequence labeling problem, we formulate it as a machine reading comprehension (MRC) problem. This formulation can introduce more prior knowledge utilizing well-designed queries, and no longer need decoding processes such as conditional random fields (CRF). We conduct experiments on six BioNER datasets, and the experimental results demonstrate the effectiveness of our method. Our method achieves state-of-the-art (SOTA) performance on the BC4CHEMD, BC5CDR-Chem, BC5CDR-Disease, NCBI-Disease, BC2GM and JNLPBA datasets, achieving F1-scores of 92.92%, 94.19%, 87.83%, 90.04%, 85.48% and 78.93%, respectively.
BERT-based Ranking for Biomedical Entity Normalization

Zongcheng Ji,Qiang Wei,Hua Xu

DOI: https://doi.org/10.48550/arXiv.1908.03548

2019-08-09

Information Retrieval

Abstract:Developing high-performance entity normalization algorithms that can alleviate the term variation problem is of great interest to the biomedical community. Although deep learning-based methods have been successfully applied to biomedical entity normalization, they often depend on traditional context-independent word embeddings. Bidirectional Encoder Representations from Transformers (BERT), BERT for Biomedical Text Mining (BioBERT) and BERT for Clinical Text Mining (ClinicalBERT) were recently introduced to pre-train contextualized word representation models using bidirectional Transformers, advancing the state-of-the-art for many natural language processing tasks. In this study, we proposed an entity normalization architecture by fine-tuning the pre-trained BERT / BioBERT / ClinicalBERT models and conducted extensive experiments to evaluate the effectiveness of the pre-trained models for biomedical entity normalization using three different types of datasets. Our experimental results show that the best fine-tuned models consistently outperformed previous methods and advanced the state-of-the-art for biomedical entity normalization, with up to 1.17% increase in accuracy.
Online biomedical named entities recognition by data and knowledge-driven model

Lulu Cao,Chaochen Wu,Guan Luo,Chao Guo,Anni Zheng

DOI: https://doi.org/10.1016/j.artmed.2024.102813

Abstract:Named entity recognition (NER) is an important task for the natural language processing of biomedical text. Currently, most NER studies standardized biomedical text, but NER for unstandardized biomedical text draws less attention from researchers. Named entities in online biomedical text exist with errors and polymorphisms, which negatively impact NER models' performance and impede support from knowledge representation methods. In this paper, we propose a neural network method that can effectively recognize entities in unstandardized online medical/health text. We introduce a new pre-training scheme that uses large-scale online question-answering pairs to enhance transformers' model capacity on online biomedical text. Moreover, we supply models with knowledge representations from a knowledge base called multi-channel knowledge labels, and this method overcomes the restriction from languages, like Chinese, that require word segmentation tools to represent knowledge. Our model outperforms other baseline methods significantly in experiments on a dataset for Chinese online medical entity recognition and achieves state-of-the-art results.
Knowledge Guided Named Entity Recognition for BioMedical Text

Pratyay Banerjee,Kuntal Kumar Pal,Murthy Devarakonda,Chitta Baral

DOI: https://doi.org/10.48550/arXiv.1911.03869

2020-09-18

Abstract:In this work, we formulate the NER task as a multi-answer knowledge guided QA task (KGQA) which helps to predict entities only by assigning B, I and O tags without associating entity types with the tags. We provide different knowledge contexts, such as, entity types, questions, definitions and examples along with the text and train on a combined dataset of 18 biomedical corpora. This formulation (a) enables systems to jointly learn NER specific features from varied NER datasets, (b) can use knowledge-text attention to identify words having higher similarity to provided knowledge, improving performance, (c) reduces system confusion by reducing the prediction classes to B, I, O only, and (d) makes detection of nested entities easier. We perform extensive experiments of this KGQA formulation on 18 biomedical NER datasets, and through experiments we note that knowledge helps in achieving better performance. Our problem formulation is able to achieve state-of-the-art results in 12 datasets.

Computation and Language,Information Retrieval,Machine Learning
Development of Biomedical Corpus Enlargement Platform Using BERT for Bio-entity Recognition

Thiptanawat Phongwattana,Jonathan H. Chan

DOI: https://doi.org/10.1007/978-3-030-36708-4_37

2019-01-01

Abstract:As the volume and availability of textual data dramatically increase in the current digital age, a major challenge is how to properly extract useful information online. A key component of the text mining pipeline is named entity recognition (NER) for extracting knowledge. Currently, there are many publicly available NER tools such as Stanford NLP, NLTK or Spacy python library. However, there is a problem of accurate unknown entity recognition. We focus on using deep learning for recognizing entities, as it has been shown to outperform traditional algorithms for big data in part of its ability for feature extraction and dealing with multi-dimensionality. In this paper, we applied the state-of-the-art language representation model termed BERT (Bidirectional Encoder Representations from Transformers) for NER classification, in order to enlarge the existing biomedical corpus for further machine learning processing. We used additional biomedical corpora for training, and then compared the results to a recent prior work. The end result is precision improvement of 2.24%, recall improvement of 3.55%, and F1-score improvement of 2.98%, in protein recognition of super-pathway of leucine, valine, and isoleucine biosynthesis. We also developed a prototype, in form of an internal web platform, for supporting bio-annotators and corpus enlargement purpose.
NanoNER: Named Entity Recognition for nanobiology using experts' knowledge and distant supervision

Martin Lentschat,Cyril Labbé,Ran Cheng

2024-01-30

Abstract:Here we present the training and evaluation of NanoNER, a Named Entity Recognition (NER) model for Nanobiology. NER consists in the identification of specific entities in spans of unstructured texts and is often a primary task in Natural Language Processing (NLP) and Information Extraction. The aim of our model is to recognise entities previously identified by domain experts as constituting the essential knowledge of the domain. Relying on ontologies, which provide us with a domain vocabulary and taxonomy, we implemented an iterative process enabling experts to determine the entities relevant to the domain at hand. We then delve into the potential of distant supervision learning in NER, supporting how this method can increase the quantity of annotated data with minimal additional manpower. On our full corpus of 728 full-text nanobiology articles, containing more than 120k entity occurrences, NanoNER obtained a F1-score of 0.98 on the recognition of previously known entities. Our model also demonstrated its ability to discover new entities in the text, with precision scores ranging from 0.77 to 0.81. Ablation experiments further confirmed this and allowed us to assess the dependency of our approach on the external resources. It highlighted the dependency of the approach to the resource, while also confirming its ability to rediscover up to 30% of the ablated terms. This paper details the methodology employed, experimental design, and key findings, providing valuable insights and directions for future related researches on NER in specialized domain. Furthermore, since our approach require minimal manpower , we believe that it can be generalized to other specialized fields.

Information Retrieval,Artificial Intelligence,Computation and Language
Biomedical named entity normalization via interaction-based synonym marginalization

Hao Peng,Ying Xiong,Yang Xiang,Hui Wang,Hui Xu,Buzhou Tang

DOI: https://doi.org/10.1016/j.jbi.2022.104238

IF: 8

2022-12-01

Journal of Biomedical Informatics

Abstract:OBJECTIVE: Biomedical named entity normalization (BNEN) is a fundamental natural language processing (NLP) task in the biomedical domain. Many representation learning-based methods have been successfully applied to BNEN in recent years. Most of them encode a given biomedical named entity mention (BNEM) and candidates separately, some of them consider relations between the BNEM and its candidates, however, few consider relations among the candidates, which may be useful for BNEN.MATERIAL AND METHODS: In this paper, we propose a novel interaction-based synonym marginalization for BNEN, which can capture both the relations between a given mention and the mention's candidates and that among the candidates, called IA-BIOSYN. In IA-BIOSYN, given a BNEM, a candidate selector is used to obtain the candidates of the BNEM dynamically, then an interaction module is used to model BNEM-candidate relations as well as candidate-candidate relations, and finally a synonym marginalization module is used to determine which candidate(s) the BNEM should be mapped to. To validate the effectiveness of our proposed method, we compare it with other state-of-the-art (SOTA) methods on three public BNEN datasets: NCBI-Disease, BC5CDR-Disease and BC5CDR-Chemical.RESULTS: Our proposed method achieves Acc@1 of 0.9333, 0.9379 and 0.9693 on NCBI-Disease, BC5CDR-Disease and BC5CDR-Chemical, respectively, significantly better than other SOTA methods.CONCLUSIONS: Both the relations between a given BNEM and its candidates, and the relations among the candidates are useful for BNEN, and the proposed IA-BIOSYN can capture the two types of relations effectively.

medical informatics,computer science, interdisciplinary applications
Improving dictionary-based named entity recognition with deep learning

Katerina Nastou,Mikaela Koutrouli,Sampo Pyysalo,Lars Juhl Jensen

DOI: https://doi.org/10.1093/bioinformatics/btae402

IF: 5.8

2024-09-01

Bioinformatics

Abstract:Motivation: Dictionary-based named entity recognition (NER) allows terms to be detected in a corpus and normalized to biomedical databases and ontologies. However, adaptation to different entity types requires new high-quality dictionaries and associated lists of blocked names for each type. The latter are so far created by identifying cases that cause many false positives through manual inspection of individual names, a process that scales poorly. Results: In this work, we aim to improve block list s by automatically identifying names to block, based on the context in which they appear. By comparing results of three well-established biomedical NER methods, we generated a dataset of over 12.5 million text spans where the methods agree on the boundaries and type of entity tagged. These were used to generate positive and negative examples of contexts for four entity types (genes, diseases, species, and chemicals), which were used to train a Transformer-based model (BioBERT) to perform entity type classification. Application of the best model (F1-score = 96.7%) allowed us to generate a list of problematic names that should be blocked. Introducing this into our system doubled the size of the previous list of corpus-wide blocked names. In addition, we generated a document-specific list that allows ambiguous names to be blocked in specific documents. These changes boosted text mining precision by ∼5.5% on average, and over 8.5% for chemical and 7.5% for gene names, positively affecting several biological databases utilizing this NER system, like the STRING database, with only a minor drop in recall (0.6%). Availability and implementation: All resources are available through Zenodo https://doi.org/10.5281/zenodo.11243139 and GitHub https://doi.org/10.5281/zenodo.10289360.
NERO: a biomedical named-entity (recognition) ontology with a large, annotated corpus reveals meaningful associations through text embedding

Kanix Wang,Robert Stevens,Halima Alachram,Yu Li,Larisa Soldatova,Ross King,Sophia Ananiadou,Annika M Schoene,Maolin Li,Fenia Christopoulou,José Luis Ambite,Joel Matthew,Sahil Garg,Ulf Hermjakob,Daniel Marcu,Emily Sheng,Tim Beißbarth,Edgar Wingender,Aram Galstyan,Xin Gao,Brendan Chambers,Weidi Pan,Bohdan B Khomtchouk,James A Evans,Andrey Rzhetsky

DOI: https://doi.org/10.1038/s41540-021-00200-x

2021-10-20

Abstract:Machine reading (MR) is essential for unlocking valuable knowledge contained in millions of existing biomedical documents. Over the last two decades1,2, the most dramatic advances in MR have followed in the wake of critical corpus development3. Large, well-annotated corpora have been associated with punctuated advances in MR methodology and automated knowledge extraction systems in the same way that ImageNet4 was fundamental for developing machine vision techniques. This study contributes six components to an advanced, named entity analysis tool for biomedicine: (a) a new, Named Entity Recognition Ontology (NERO) developed specifically for describing textual entities in biomedical texts, which accounts for diverse levels of ambiguity, bridging the scientific sublanguages of molecular biology, genetics, biochemistry, and medicine; (b) detailed guidelines for human experts annotating hundreds of named entity classes; (c) pictographs for all named entities, to simplify the burden of annotation for curators; (d) an original, annotated corpus comprising 35,865 sentences, which encapsulate 190,679 named entities and 43,438 events connecting two or more entities; (e) validated, off-the-shelf, named entity recognition (NER) automated extraction, and; (f) embedding models that demonstrate the promise of biomedical associations embedded within this corpus.
Advantage of gH-difference on the second-order fuzzy linear differential equations with constant coefficients

M. Keshavarz,E. Firouz,T. Allahviranloo

DOI: https://doi.org/10.1109/CFIS.2015.7391643

2015-09-01

Abstract:In this article by using the concept of generalized Hukuhara difference, the second-order fuzzy differential equation problem with constant coefficients is solved. Then the solution will be compared with each other in two cases. The first case is, when displacement is not performed. It means: the right side of second-order fuzzy differential equation is not transferred to the left side. The second case is when displacement is performed by applying generalized Hukuhara difference concept. We show that forcing term under gH-difference dose no exist when displacement is not performed, the solutions of bout fuzzy differential equations are the same by considering gH-difference.
BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition

Usman Naseem,Matloob Khushi,Vinay Reddy,Sakthivel Rajendran,Imran Razzak,Jinman Kim

DOI: https://doi.org/10.1109/ijcnn52387.2021.9533884

2021-07-18

Abstract:In recent years, with the growing amount of biomedical documents, coupled with advancement in natural language processing algorithms, the research on biomedical named entity recognition (BioNER) has increased exponentially. However, BioNER research is challenging as NER in the biomedical domain are: (i) often restricted due to limited amount of training data, (ii) an entity can refer to multiple types and concepts depending on its context and, (iii) heavy reliance on acronyms that are sub-domain specific. Existing BioNER approaches often neglect these issues and directly adopt the state-of-the-art (SOTA) models trained in general corpora, which often yields unsatisfactory results. We propose biomedical ALBERT (A Lite Bidirectional Encoder Representations from Transformers for Biomedical Text Mining) - bioALBERT - an effective domain-specific pre-trained language model trained on a huge biomedical corpus designed to capture biomedical context-dependent NER. We adopted a self-supervised loss function used in ALBERT that targets modelling inter-sentence coherence to better learn context-dependent representations and incorporated parameter reduction strategies to minimise memory usage and enhance the training time in BioNER. In our experiments, BioALBERT outperformed comparative SOTA BioNER models on 8 biomedical NER benchmark datasets with 4 different entity types. The performance is increased for; (i) disease type corpora by 7.47% (NCBI- disease) and 10.63% (BC5CDR-disease); (ii) drug-chem type corpora by 4.61 % (BC5CDR-Chem) and 3.89% (BC4CHEMD); (iii) gene-protein type corpora by 12.25% (BC2GM) and 6.42% (JNLPBA); and (iv) species type corpora by 6.19% (LINNAEUS) and 23.71 % (Species-800) is observed which leads to a state-of-the-art results. The performance of a proposed model on four different biomedical entity types shows that our model is robust and generalisable in recognising biomedical entities in text.
Empowering Biomedical Named Entity Recognition Through Multi-Tagger Collaboration

Jin Zhao,Jian Xie,Tinghui Zhu,Qian Guo,Zhixu Li,Yanghua Xiao

DOI: https://doi.org/10.3233/faia240611

2024-01-01

Abstract:Biomedical Named Entity Recognition (BioNER) plays a crucial role in automatically identifying specific categories of entities from biomedical texts. Currently, region-based methods have shown promising performance in BioNER. However, existing paradigms in the region-based methods suffer from inherent limitations, including the generation of negative samples, and the ignorance of token dependencies. To overcome these limitations, we propose a new paradigm, implemented as Token Cascade Tagger (TCT), which combines span identification and category classification. The TCT utilizes category information to enhance the correlation between the heads and tails of entities, effectively reducing the generation of negative samples. Additionally, we introduce a Token Dependency Tagger (TDT) that captures token dependencies within entity spans by identifying the longest span in a sentence. The TDT filters out incorrect spans and further improves the accuracy of span detection obtained from the TCT. Furthermore, we employ a multi-task learning framework to optimize both the TCT and TDT, leading to superior performance in BioNER. Extensive experiments on publicly available biomedical datasets demonstrate our method outperforms the previous state-of-the-art methods, achieving 92.44%, 92.54%, and 81.26% on NCBI-Disease, BC5CDR, and GENIA, respectively, in terms of F1 score.

Systematic approach to the identification of toxic organic compounds isolated from tissues and fluids. III. Aquo-ferriate and stannic chloride tests.

Improving Biomedical Named Entity Recognition with a Unified Multi-Task MRC Framework

NERBio: using selected word conjunctions, term normalization, and global patterns to improve biomedical named entity recognition

Solid‐phase synthesis and screening of a library of C‐terminal arginine peptide aldehydes against Murray Valley encephalitis virus protease

Improving the recall of biomedical named entity recognition with label re-correction and knowledge distillation

Research on Named Entity Recognition from Biomedical Literature

Improving Biomedical Named Entity Recognition with Label Re-correction and Knowledge Distillation

Biomedical named entity recognition using deep neural networks with contextual information

Biomedical Entity Normalization based on Pre-trained Model with Enhanced Information.

Biomedical named entity recognition using BERT in the machine reading comprehension framework

BERT-based Ranking for Biomedical Entity Normalization

Online biomedical named entities recognition by data and knowledge-driven model

Knowledge Guided Named Entity Recognition for BioMedical Text

Development of Biomedical Corpus Enlargement Platform Using BERT for Bio-entity Recognition

NanoNER: Named Entity Recognition for nanobiology using experts' knowledge and distant supervision

Biomedical named entity normalization via interaction-based synonym marginalization

Improving dictionary-based named entity recognition with deep learning

NERO: a biomedical named-entity (recognition) ontology with a large, annotated corpus reveals meaningful associations through text embedding

Advantage of gH-difference on the second-order fuzzy linear differential equations with constant coefficients

BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition

Empowering Biomedical Named Entity Recognition Through Multi-Tagger Collaboration