Abstract:The automatic recognition of biomedical relationships is an important step in the semantic understanding of the information contained in the unstructured text of the published literature. The BioRED track at BioCreative VIII aimed to foster the development of such methods by providing the participants the BioRED-BC8 corpus, a collection of 1000 PubMed documents manually curated for diseases, gene/proteins, chemicals, cell lines, gene variants, and species, as well as pairwise relationships between them which are disease-gene, chemical-gene, disease-variant, gene-gene, chemical-disease, chemical-chemical, chemical-variant, and variant-variant. Furthermore, relationships are categorized into the following semantic categories: positive correlation, negative correlation, binding, conversion, drug interaction, comparison, cotreatment, and association. Unlike most of the previous publicly available corpora, all relationships are expressed at the document level as opposed to the sentence level, and as such, the entities are normalized to the corresponding concept identifiers of the standardized vocabularies, namely, diseases and chemicals are normalized to MeSH, genes (and proteins) to National Center for Biotechnology Information (NCBI) Gene, species to NCBI Taxonomy, cell lines to Cellosaurus, and gene/protein variants to Single Nucleotide Polymorphism Database. Finally, each annotated relationship is categorized as 'novel' depending on whether it is a novel finding or experimental verification in the publication it is expressed in. This distinction helps differentiate novel findings from other relationships in the same text that provides known facts and/or background knowledge. The BioRED-BC8 corpus uses the previous BioRED corpus of 600 PubMed articles as the training dataset and includes a set of newly published 400 articles to serve as the test data for the challenge. All test articles were manually annotated for the BioCreative VIII challenge by expert biocurators at the National Library of Medicine, using the original annotation guidelines, where each article is doubly annotated in a three-round annotation process until full agreement is reached between all curators. This manuscript details the characteristics of the BioRED-BC8 corpus as a critical resource for biomedical named entity recognition and relation extraction. Using this new resource, we have demonstrated advancements in biomedical text-mining algorithm development. Database URL: https://codalab.lisn.upsaclay.fr/competitions/16381.

EnzChemRED, a rich enzyme chemistry relation extraction dataset

BioRED: a rich biomedical relation extraction dataset

Enzyme annotation in UniProtKB using Rhea

OpenChemIE: An Information Extraction Toolkit For Chemistry Literature

ReactZyme: A Benchmark for Enzyme-Reaction Prediction

Automated Chemical Reaction Extraction from Scientific Literature

BioREx: Improving Biomedical Relation Extraction by Leveraging Heterogeneous Datasets

The biomedical relationship corpus of the BioRED track at the BioCreative VIII challenge and workshop

FoodChem: A food-chemical relation extraction model

Vocabulary Matters: An Annotation Pipeline and Four Deep Learning Algorithms for Enzyme Named Entity Recognition

The CHEMDNER corpus of chemicals and drugs and its annotation principles

End-to-End Models for Chemical-Protein Interaction Extraction: Better Tokenization and Span-Based Pipeline Strategies

A large-scale evaluation of NLP-derived chemical-gene/protein relationships from the scientific literature: Implications for knowledge graph construction

CEAR: Automatic construction of a knowledge graph of chemical entities and roles from scientific literature

Integrating deep learning architectures for enhanced biomedical relation extraction: a pipeline approach

Docred: A Large-Scale Document-Level Relation Extraction Dataset

NLM-Chem, a new resource for chemical entity recognition in PubMed full text literature

The overview of the BioRED (Biomedical Relation Extraction Dataset) track at BioCreative VIII

CARE: a Benchmark Suite for the Classification and Retrieval of Enzymes

Relation Extraction in underexplored biomedical domains: A diversity-optimised sampling and synthetic data generation approach

Descriptor-augmented machine learning for enzyme-chemical interaction predictions