Abstract:Background : Knowledge is evolving over time, often as a result of new discoveries or changes in the adopted methods of reasoning. Also, new facts or evidence may become available, leading to new understandings of complex phenomena. This is particularly true in the biomedical field, where scientists and physicians are constantly striving to find new methods of diagnosis, treatment and eventually cure. Knowledge Graphs (KGs) offer a real way of organizing and retrieving the massive and growing amount of biomedical knowledge. Objective : We propose an end-to-end approach for knowledge extraction and analysis from biomedical clinical notes using the Bidirectional Encoder Representations from Transformers (BERT) model and Conditional Random Field (CRF) layer. Methods : The approach is based on knowledge graphs, which can effectively process abstract biomedical concepts such as relationships and interactions between medical entities. Besides offering an intuitive way to visualize these concepts, KGs can solve more complex knowledge retrieval problems by simplifying them into simpler representations or by transforming the problems into representations from different perspectives. We created a biomedical Knowledge Graph using using Natural Language Processing models for named entity recognition and relation extraction. The generated biomedical knowledge graphs (KGs) are then used for question answering. Results : The proposed framework can successfully extract relevant structured information with high accuracy (90.7% for Named-entity recognition (NER), 88% for relation extraction (RE)), according to experimental findings based on real-world 505 patient biomedical unstructured clinical notes. Conclusions : In this paper, we propose a novel end-to-end system for the construction of a biomedical knowledge graph from clinical textual using a variation of BERT models.

BERT-based knowledge extraction method of unstructured domain text

K-BERT: Enabling Language Representation with Knowledge Graph

BB-KBQA: BERT-Based Knowledge Base Question Answering

Rapid Adaptation of BERT for Information Extraction on Domain-Specific Business Documents

Research on Domain-Specific Knowledge Graph Based on the RoBERTa-wwm-ext Pretraining Model

Knowledge Extraction in Low-Resource Scenarios: Survey and Perspective

Knowledge Graph Anchored Information-Extraction for Domain-Specific Insights

BERT Based Clinical Knowledge Extraction for Biomedical Knowledge Graph Construction and Analysis

BERT and hierarchical cross attention-based question answering over bridge inspection knowledge graph

Knowledge enhanced graph inference network based entity-relation extraction and knowledge graph construction for industrial domain

Cross-Domain Data Extraction and Knowledge Graph Construction for Dispute Analysis

Bert-Based Text Keyword Extraction

Knowledge-guided Open Attribute Value Extraction with Reinforcement Learning

Integrating deep learning and multi-attention for joint extraction of entities and relationships in engineering consulting texts

Scalable and Noise Tolerant Web Knowledge Extraction for Search Task Simplification.

Knowledge-Enhanced Retrieval: A Scheme for Question Answering

Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning

Banking System Incidents Analysis Using Knowledge Graph

A Knowledge Extraction Framework for Domain-Specific Application with Simplified Pre-Trained Language Model and Attention-Based Feature Extractor

Improving Attention Network to Realize Joint Extraction for the Construction of Equipment Knowledge Graph

WebKE: Knowledge Extraction from Semi-structured Web with Pre-trained Markup Language Model