Abstract:Extracting entities and relations from text is a significant task of information extraction. Existing extraction models often straightforwardly produce their confident prediction results without any reconsideration or double-checking, resulting in avoidable mistakes and sub-optimal performance. In this paper, we propose a novel coarse-to-fine extraction framework, which first extracts high-potential relations as well as entities via knowledge distillation, and then rechecks the predictions via handcrafted natural language inference (NLI) task in a fine-grained manner. Specifically, based on the knowledge distillation mechanism, we train multiple teacher models iteratively through an adaptive loss function for making one teacher concentrate more on the data that others are incompetent for. Then, these complementary teacher models are utilized to provide valuable soft-label information for training a considerate student model, enabling it to generate reliable preliminary predictions. Further, these generated potential relations and entities are formulated as hypotheses, together with the original sentences as premises, serving as the input for an NLI model. Considering the linguistic diversity of relational expression, we automatically generate various semantic templates for hypotheses through an <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathcal{N}$</tex> -gram mining strategy. Moreover, due to the existence of multi-fact sentences, a relation-guided Gaussian attention is designed to reduce the gap between the single-relation hypothesis and the multi-relation premise. To implement efficient training, we also develop several ways to generate high-quality negative samples, which help the NLI model learn to identify errors. Experimental results show that the proposed method is effective and outperforms other strong baselines on public benchmarks.

BERT-BIGRU-CRF: A Novel Entity Relationship Extraction Model

Enriching Pre-trained Language Model with Entity Information for Relation Classification

RECA: Relation Extraction Based on Cross-Attention Neural Network

A Method of Relation Extraction Using Pre-training Models

Bi-GRU Relation Extraction Model Based on Keywords Attention

A Novel Chinese Entity Relationship Extraction Method Based on the Bidirectional Maximum Entropy Markov Model

A Method for Chinese Entity Relationship Extraction Based on Bi-GRU

Entity Relationship Extraction Based on BLSTM Model

A joint model for entity and relation extraction based on BERT

Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network

End-to-end Named Entity Recognition and Relation Extraction using Pre-trained Language Models

Improve on Entity Recognition Method Based on BiLSTM-CRF Model for the Nuclear Technology Knowledge Graph

A neuralized feature engineering method for entity relation extraction

Entity relation joint extraction model combining pointer network and attention mechanism based on relative position embedding

Named Entity Recognition by Using XLNet-BiLSTM-CRF

BERT gated multi-window attention network for relation extraction

Joint extraction of entity relations from geological reports based on a novel relation graph convolutional network

A Coarse-to-Fine Framework for Entity-Relation Joint Extraction.

Entity relationship extraction optimization based on entity recognition

Entity-Relation Extraction As Full Shallow Semantic Dependency Parsing

An Entity-Relation Joint Extraction Method Based on Two Independent Sub-Modules From Unstructured Text