Abstract:Extracting entities and relations from text is a significant task of information extraction. Existing extraction models often straightforwardly produce their confident prediction results without any reconsideration or double-checking, resulting in avoidable mistakes and sub-optimal performance. In this paper, we propose a novel coarse-to-fine extraction framework, which first extracts high-potential relations as well as entities via knowledge distillation, and then rechecks the predictions via handcrafted natural language inference (NLI) task in a fine-grained manner. Specifically, based on the knowledge distillation mechanism, we train multiple teacher models iteratively through an adaptive loss function for making one teacher concentrate more on the data that others are incompetent for. Then, these complementary teacher models are utilized to provide valuable soft-label information for training a considerate student model, enabling it to generate reliable preliminary predictions. Further, these generated potential relations and entities are formulated as hypotheses, together with the original sentences as premises, serving as the input for an NLI model. Considering the linguistic diversity of relational expression, we automatically generate various semantic templates for hypotheses through an <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathcal{N}$</tex> -gram mining strategy. Moreover, due to the existence of multi-fact sentences, a relation-guided Gaussian attention is designed to reduce the gap between the single-relation hypothesis and the multi-relation premise. To implement efficient training, we also develop several ways to generate high-quality negative samples, which help the NLI model learn to identify errors. Experimental results show that the proposed method is effective and outperforms other strong baselines on public benchmarks.

A Joint Learning Information Extraction Method Based on an Effective Inference Structure

An Active Learning Based Hybrid Neural Network for Joint Information Extraction.

An Entity-Relation Joint Extraction Method Based on Two Independent Sub-Modules From Unstructured Text

A Coarse-to-Fine Framework for Entity-Relation Joint Extraction.

TABLEIE: Capturing the Interactions among Sub-Tasks in Information Extraction Via Double Tables

Ensemble Method to Joint Inference for Knowledge Extraction

Towards Nested and Fine-Grained Open Information Extraction

Joint Inference for Knowledge Base Population

Encoding Relation Requirements for Relation Extraction Via Joint Inference

An Effective System for Multi-format Information Extraction

Modeling Instance Interactions for Joint Information Extraction with Neural High-Order Conditional Random Field

A Cascade Dual-Decoder Model for Joint Entity and Relation Extraction

Joint Constrained Learning for Event-Event Relation Extraction

Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environment

An Iterative Graph Learning Convolution Network for Key Information Extraction Based on the Document Inductive Bias.

Joint extraction of entities and relations based on character graph convolutional network and Multi-Head Self-Attention Mechanism

A Regularization-based Transfer Learning Method for Information Extraction via Instructed Graph Decoder

A Joint Entity and Relation Extraction Model based on Efficient Sampling and Explicit Interaction

Joint Extraction of Entities and Relations Based on a Novel Decomposition Strategy

Leveraging Knowledge Graph Embeddings to Enhance Contextual Representations for Relation Extraction

Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference