Abstract:Background: Knowledge graphs are a powerful tool for organizing knowledge, processing information and integrating scattered information, effectively visualizing the relationships among entities and supporting further intelligent applications. One of the critical tasks in building knowledge graphs is knowledge extraction. The existing knowledge extraction models in the Chinese medical domain usually require high-quality and large-scale manually labeled corpora for model training. In this study, we investigate rheumatoid arthritis (RA)-related Chinese electronic medical records (CEMRs) and address the automatic knowledge extraction task with a small number of annotated samples from CEMRs, from which an authoritative RA knowledge graph is constructed.Methods: After constructing the domain ontology of RA and completing manual labeling, we propose the MC-bidirectional encoder representation from transformers-bidirectional long short-term memory-conditional random field (BERT-BiLSTM-CRF) model for the named entity recognition (NER) task and the MC-BERT + feedforward neural network (FFNN) model for the entity extraction task. The pretrained language model (MC-BERT) is trained with many unlabeled medical data and fine-tuned using other medical domain datasets. We apply the established model to automatically label the remaining CEMRs, and then an RA knowledge graph is constructed based on the entities and entity relations, a preliminary assessment is conducted, and an intelligent application is presented.Results: The proposed model achieved better performance than that of other widely used models in knowledge extraction tasks, with mean F1 scores of 92.96% in entity recognition and 95.29% in relation extraction. This study preliminarily confirmed that using a pretrained medical language model could solve the problem that knowledge extraction from CEMRs requires a large number of manual annotations. An RA knowledge graph based on the above identified entities and extracted relations from 1,986 CEMRs was constructed. Experts verified the effectiveness of the constructed RA knowledge graph.Conclusions: In this paper, an RA knowledge graph based on CEMRs was established, the processes of data annotation, automatic knowledge extraction, and knowledge graph construction were described, and a preliminary assessment and an application were presented. The study demonstrated the viability of a pretrained language model combined with a deep neural network for knowledge extraction tasks from CEMRs based on a small number of manually annotated samples.

Can Deep Learning Large Language Models be Used to Unravel Knowledge Graph Creation?

Comparison of biomedical relationship extraction methods and models for knowledge graph creation

Leveraging A Medical Knowledge Graph into Large Language Models for Diagnosis Prediction

Automatic knowledge extraction from Chinese electronic medical records and rheumatoid arthritis knowledge graph construction

Large Language Models and Medical Knowledge Grounding for Diagnosis Prediction

Knowledge graph construction for heart failure using large language models with prompt engineering

Large Language Models for Biomedical Knowledge Graph Construction: Information extraction from EMR notes

Generating Knowledge Graphs from Large Language Models: A Comparative Study of GPT-4, LLaMA 2, and BERT

Empowering Graph Neural Network-Based Computational Drug Repositioning with Large Language Model-Inferred Knowledge Representation

Enhancing Knowledge Graph Construction Using Large Language Models

Utilizing BERT for entity relationship extraction in Chinese medical texts

Interpreting Language Models Through Knowledge Graph Extraction

Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs

Think and Retrieval: A Hypothesis Knowledge Graph Enhanced Medical Large Language Models

Applying BioBERT to Extract Germline Gene-Disease Associations for Building a Knowledge Graph from the Biomedical Literature

Ensemble pretrained language models to extract biomedical knowledge from literature

AI-assisted Knowledge Discovery in Biomedical Literature to Support Decision-making in Precision Oncology

Evaluation of a prototype machine learning tool to semi-automate data extraction for systematic literature reviews

Fact Finder -- Enhancing Domain Expertise of Large Language Models by Incorporating Knowledge Graphs