Abstract:Transcriptional regulatory networks (TRNs) give a global view of the regulatory mechanisms of bacteria to respond to environmental signals. These networks are published in biological databases as a valuable resource for experimental and bioinformatics researchers. Despite the efforts to publish TRNs of diverse bacteria, many of them still lack one and many of the existing TRNs are incomplete. In addition, the manual extraction of information from biomedical literature ("literature curation") has been the traditional way to extract these networks, despite this being demanding and time-consuming. Recently, language models based on pretrained transformers have been used to extract relevant knowledge from biomedical literature. Moreover, the benefit of fine-tuning a large pretrained model with new limited data for a specific task ("transfer learning") opens roads to address new problems of biomedical information extraction. Here, to alleviate this lack of knowledge and assist literature curation, we present a new approach based on the Bidirectional Transformer for Language Understanding (BERT) architecture to classify transcriptional regulatory interactions of bacteria as a first step to extract TRNs from literature. The approach achieved a significant performance in a test dataset of sentences of Escherichia coli (F1-Score: 0.8685, Matthew's correlation coefficient: 0.8163). The examination of model predictions revealed that the model learned different ways to express the regulatory interaction. The approach was evaluated to extract a TRN of Salmonella using 264 complete articles. The evaluation showed that the approach was able to accurately extract 82% of the network and that it was able to extract interactions absent in curation data. To the best of our knowledge, the present study is the first effort to obtain a BERT-based approach to extract this specific kind of interaction. This approach is a starting point to address the limitations of reconstructing TRNs of bacteria and diseases of biological interest. Database URL: https://github.com/laigen-unam/BERT-trn-extraction.

BioBERT Based SNP-traits Associations Extraction from Biomedical Literature

Automatic Extraction of Ranked SNP-Phenotype Associations from Literature through Detecting Neural Candidates, Negation and Modality Markers

Applying BioBERT to Extract Germline Gene-Disease Associations for Building a Knowledge Graph from the Biomedical Literature

Biomedical literature mining: graph kernel-based learning for gene–gene interaction extraction

BiOnt: Deep Learning using Multiple Biomedical Ontologies for Relation Extraction

BioBERT-based Deep Learning and Merged ChemProt-DrugProt for Enhanced Biomedical Relation Extraction

BioBERT: a pre-trained biomedical language representation model for biomedical text mining

Using BERT to identify drug-target interactions from whole PubMed

AI-assisted Knowledge Discovery in Biomedical Literature to Support Decision-making in Precision Oncology

Using Neural Networks for Relation Extraction from Biomedical Literature

Gene–disease Association Extraction by Text Mining and Network Analysis

BioBERT and Similar Approaches for Relation Extraction

A Combined Manual Annotation and Deep-Learning Natural Language Processing Study on Accurate Entity Extraction in Hereditary Disease Related Biomedical Literature

A MeSH-based Biomedical Literature Mining Method for Exploring Associations Between Genes and Clinical Terms

Evaluation of GPT and BERT-based models on identifying proteinprotein interactions in biomedical text

Automatic extraction of transcriptional regulatory interactions of bacteria from biomedical literature using a BERT-based approach

Automatic extraction of gene-disease associations from literature using joint ensemble learning

Automated Text Mining of Experimental Methodologies from Biomedical Literature

Literature mining discerns latent disease–gene relationships