Abstract:Background: Vaccines have revolutionized public health by providing protection against infectious diseases. They stimulate the immune system and generate memory cells to defend against targeted diseases. Clinical trials evaluate vaccine performance, including dosage, administration routes, and potential side effects. Clinicaltrials: gov is a valuable repository of clinical trial information, but the vaccine data in them lacks standardization, leading to challenges in automatic concept mapping, vaccine-related knowledge development, evidence-based decision-making, and vaccine surveillance. Results: In this study, we developed a cascaded framework that capitalized on multiple domain knowledge sources, including clinical trials, the Unified Medical Language System (UMLS), and the Vaccine Ontology (VO), to enhance the performance of domain-specific language models for automated mapping of VO from clinical trials. The Vaccine Ontology (VO) is a community-based ontology that was developed to promote vaccine data standardization, integration, and computer-assisted reasoning. Our methodology involved extracting and annotating data from various sources. We then performed pre-training on the PubMedBERT model, leading to the development of CTPubMedBERT. Subsequently, we enhanced CTPubMedBERT by incorporating SAPBERT, which was pretrained using the UMLS, resulting in CTPubMedBERT + SAPBERT. Further refinement was accomplished through fine-tuning using the Vaccine Ontology corpus and vaccine data from clinical trials, yielding the CTPubMedBERT + SAPBERT + VO model. Finally, we utilized a collection of pre-trained models, along with the weighted rule-based ensemble approach, to normalize the vaccine corpus and improve the accuracy of the process. The ranking process in concept normalization involves prioritizing and ordering potential concepts to identify the most suitable match for a given context. We conducted a ranking of the Top 10 concepts, and our experimental results demonstrate that our proposed cascaded framework consistently outperformed existing effective baselines on vaccine mapping, achieving 71.8% on top 1 candidate's accuracy and 90.0% on top 10 candidate's accuracy. Conclusion: This study provides a detailed insight into a cascaded framework of fine-tuned domain-specific language models improving mapping of VO from clinical trials. By effectively leveraging domain-specific information and applying weighted rule-based ensembles of different pre-trained BERT models, our framework can significantly enhance the mapping of VO from clinical trials.

Concept placement using BERT trained by transforming and summarizing biomedical ontology structure

A Language Model based Framework for New Concept Placement in Ontologies

Semantic Annotation with RescoredESA

A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts

Learning Concept Hierarchies from Scientific Articles for Ontology Construction

Exploring the In-context Learning Ability of Large Language Model for Biomedical Concept Linking

A Novel Framework for Biomedical Entity Sense Induction.

Unified Medical Language System resources improve sieve-based generation and Bidirectional Encoder Representations from Transformers (BERT)–based ranking for concept normalization

Matching Biomedical Ontologies via a Hybrid Graph Attention Network

Automatic Structuring of Ontology Terms Based on Lexical Granularity and Machine Learning: Algorithm Development and Validation

A knowledge-driven approach to biomedical document conceptualization

Evaluating Biomedical BERT Models for Vocabulary Alignment at Scale in the UMLS Metathesaurus

Ontology Completion with Natural Language Inference and Concept Embeddings: An Analysis

Continual knowledge infusion into pre-trained biomedical language models

Using concept-based indexing to improve language modeling approach to genomic IR

Leveraging logical definitions and lexical features to detect missing IS-A relations in biomedical terminologies

BiOnt: Deep Learning using Multiple Biomedical Ontologies for Relation Extraction

Rare Disease Identification from Clinical Notes with Ontologies and Weak Supervision

Mapping vaccine names in clinical trials to vaccine ontology using cascaded fine-tuned domain-specific language models