Abstract:Extracting entities and relations from text is a significant task of information extraction. Existing extraction models often straightforwardly produce their confident prediction results without any reconsideration or double-checking, resulting in avoidable mistakes and sub-optimal performance. In this paper, we propose a novel coarse-to-fine extraction framework, which first extracts high-potential relations as well as entities via knowledge distillation, and then rechecks the predictions via handcrafted natural language inference (NLI) task in a fine-grained manner. Specifically, based on the knowledge distillation mechanism, we train multiple teacher models iteratively through an adaptive loss function for making one teacher concentrate more on the data that others are incompetent for. Then, these complementary teacher models are utilized to provide valuable soft-label information for training a considerate student model, enabling it to generate reliable preliminary predictions. Further, these generated potential relations and entities are formulated as hypotheses, together with the original sentences as premises, serving as the input for an NLI model. Considering the linguistic diversity of relational expression, we automatically generate various semantic templates for hypotheses through an <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathcal{N}$</tex> -gram mining strategy. Moreover, due to the existence of multi-fact sentences, a relation-guided Gaussian attention is designed to reduce the gap between the single-relation hypothesis and the multi-relation premise. To implement efficient training, we also develop several ways to generate high-quality negative samples, which help the NLI model learn to identify errors. Experimental results show that the proposed method is effective and outperforms other strong baselines on public benchmarks.

Joint Model of Entity Recognition and Relation Extraction with Self-attention Mechanism

Joint extraction of entities and relations via an entity correlated attention neural model

Fine-tuning BERT for Joint Entity and Relation Extraction in Chinese Medical Text

A joint entity Relation Extraction method for document level Traditional Chinese Medicine texts

BAMRE: Joint extraction model of Chinese medical entities and relations based on Biaffine transformation with relation attention

A neural joint model for entity and relation extraction from biomedical text

A Joint Model for Chinese Medical Entity and Relation Extraction Based on Graph Convolutional Networks

A Discrete Joint Model for Entity and Relation Extraction from Clinical Notes

Entity relation joint extraction model combining pointer network and attention mechanism based on relative position embedding

Modeling of joint extraction of entity relationships in clinical electronic medical records

A tag based joint extraction model for Chinese medical text

Attention-based Deep Residual Learning Network for Entity Relation Extraction in Chinese EMRs

Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network

A Joint Entity and Relation Extraction Model based on Efficient Sampling and Explicit Interaction

Joint extraction of Chinese medical entities and relations based on RoBERTa and single-module global pointer

Recurrent neural networks with segment attention and entity description for relation extraction from clinical texts

CARE: Co-Attention Network for Joint Entity and Relation Extraction

Joint Learning-based Causal Relation Extraction from Biomedical Literature

Leveraging a Joint learning Model to Extract Mixture Symptom Mentions from Traditional Chinese Medicine Clinical Notes

A Coarse-to-Fine Framework for Entity-Relation Joint Extraction.

An Attention-Based Model Using Character Composition of Entities in Chinese Relation Extraction