Abstract:Relation classification is one of the important tasks in natural language processing, which aims to determine the relationship between entities given a sentence and their respective positions. Most of the existing methods for relation classification are based on neural networks using pre-trained models such as BERT. In recent years, models based on pre-trained models like BERT have achieved excellent results in relation classification tasks in general domains. However, these methods often struggle when applied to specialized domains due to the limitations of the corpora used for BERT pre-training. Most pre-trained models are trained on text corpora from general sources like Wikipedia, which cover a wide range of domains. As a result, the content of these corpora in specific domains is limited and lacks the necessary expertise, leading to subpar performance of relation classification models in specific domains. While providing a large number of domain-specific corpora to pre-trained models could potentially address this issue, it comes with limitations such as increased computational requirements and insufficient training of specialized vocabulary. This paper proposes a method inspired by the K-BERT pre-training model to incorporate triplet knowledge from domain knowledge graphs into sentence sequences. The triplets are transformed into sentence trees and then fed into the BERT pre-trained model using absolute and relative indices. Our model has achieved an accuracy of 93.06%, which is markedly higher than that of any other baseline approach. This approach allows the incorporation of domain knowledge without significantly increasing the computational complexity. Additionally, the paper introduces a partial input method that enables the computer to understand input sentences from multiple dimensions and hierarchical levels. Experimental results on a medical domain dataset for relation classification, which includes type labels, demonstrate significant advantages over other relation classification models in terms of Accuracy.

Domain Knowledge-Driven Relation Extraction Methods

Enriching Pre-trained Language Model with Entity Information for Relation Classification

Siamese BERT Model with Adversarial Training for Relation Classification.

Joint Extraction of Triple Knowledge Based on Relation Priority.

A Brief Review of Relation Extraction Based on Pre-Trained Language Models

Relation Extraction Via Domain-aware Transfer Learning

Transfer Learning for Relation Extraction Via Relation-Gated Adversarial Learning

Exploratory Neural Relation Classification for Domain Knowledge Acquisition.

A general approach for improving deep learning-based medical relation extraction using a pre-trained model and fine-tuning

Improving Relation Extraction by Knowledge Representation Learning

BioBERT and Similar Approaches for Relation Extraction

Domain Terminology Knowledge Graph Completion Method Based on Bert

Relation Classification Via BERT with Piecewise Convolution and Focal Loss

TL-BERT - A Novel Biomedical Relation Extraction Approach.

Chinese Triple Extraction Based on BERT Model

Relation Extraction with BERT-based Pre-trained Model.

An Empirical Study on Relation Extraction in the Biomedical Domain

Relation Extraction in Biomedical Texts: A Cross-Sentence Approach

A Method of Relation Extraction Using Pre-training Models

A Clustering Based Approach For Domain Relevant Relation Extraction

Relation Classification In Knowledge Graph Based On Natural Language Text