Abstract:Extracting entities and relations from text is a significant task of information extraction. Existing extraction models often straightforwardly produce their confident prediction results without any reconsideration or double-checking, resulting in avoidable mistakes and sub-optimal performance. In this paper, we propose a novel coarse-to-fine extraction framework, which first extracts high-potential relations as well as entities via knowledge distillation, and then rechecks the predictions via handcrafted natural language inference (NLI) task in a fine-grained manner. Specifically, based on the knowledge distillation mechanism, we train multiple teacher models iteratively through an adaptive loss function for making one teacher concentrate more on the data that others are incompetent for. Then, these complementary teacher models are utilized to provide valuable soft-label information for training a considerate student model, enabling it to generate reliable preliminary predictions. Further, these generated potential relations and entities are formulated as hypotheses, together with the original sentences as premises, serving as the input for an NLI model. Considering the linguistic diversity of relational expression, we automatically generate various semantic templates for hypotheses through an <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathcal{N}$</tex> -gram mining strategy. Moreover, due to the existence of multi-fact sentences, a relation-guided Gaussian attention is designed to reduce the gap between the single-relation hypothesis and the multi-relation premise. To implement efficient training, we also develop several ways to generate high-quality negative samples, which help the NLI model learn to identify errors. Experimental results show that the proposed method is effective and outperforms other strong baselines on public benchmarks.

An Active Learning Based Hybrid Neural Network for Joint Information Extraction.

Rescue Implicit and Long-tail Cases: Nearest Neighbor Relation Extraction

A Joint Learning Information Extraction Method Based on an Effective Inference Structure

A Coarse-to-Fine Framework for Entity-Relation Joint Extraction.

Joint extraction of entities and relations via an entity correlated attention neural model

Joint Extraction of Entity and Relation with Information Redundancy Elimination

Distantly-Supervised Joint Extraction with Noise-Robust Learning

Similarity-based Memory Enhanced Joint Entity and Relation Extraction

Learning with Joint Cross-Document Information Via Multi-Task Learning for Named Entity Recognition

A region-based hypergraph network for joint entity-relation extraction

Neural Knowledge Acquisition via Mutual Attention Between Knowledge Graph and Text.

CARE: Co-Attention Network for Joint Entity and Relation Extraction

A Joint Entity and Relation Extraction Model based on Efficient Sampling and Explicit Interaction

Neural Entity Summarization with Joint Encoding and Weak Supervision

Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme

Improving Neural Relation Extraction with Implicit Mutual Relations

REET: Joint Relation Extraction and Entity Typing via Multi-task Learning

Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network

Jointly Learning Span Extraction and Sequence Labeling for Information Extraction from Business Documents

CJE-PCHF: Chinese Joint Entity and Relation Extraction Model Based on Progressive Contrastive Learning and Heterogeneous Feature Fusion

An Entity-Relation Joint Extraction Method Based on Two Independent Sub-Modules From Unstructured Text