Abstract:Relation Extraction (RE) is a vital step to complete Knowledge Graph (KG) by extracting entity relations from texts. However, it usually suffers from the long-tail issue. The training data mainly concentrates on a few types of relations, leading to the lack of sufficient annotations for the remaining types of relations. In this paper, we propose a general approach to learn relation prototypes from unlabeled texts, to facilitate the long-tail relation extraction by transferring knowledge from the relation types with sufficient training data. We learn relation prototypes as an implicit factor between entities, which reflects the meanings of relations as well as their proximities for transfer learning. Specifically, we construct a co-occurrence graph from texts, and capture both first-order and second-order entity proximities for embedding learning. Based on this, we further optimize the distance from entity pairs to corresponding prototypes, which can be easily adapted to almost arbitrary RE frameworks. Thus, the learning of infrequent or even unseen relation types will benefit from semantically proximate relations through pairs of entities and large-scale textual information. We have conducted extensive experiments on two publicly available datasets: New York Times and Google Distant Supervision. Compared with eight state-of-the-art baselines, our proposed model achieves significant improvements (4.1 percent F1 on average). Further results on long-tail relations demonstrate the effectiveness of the learned relation prototypes. We further conduct an ablation study to investigate the impacts of varying components, and apply it to four basic relation extraction models to verify the generalization ability. Finally, we analyze several example cases to give intuitive impressions as qualitative analysis.

LTACL: long-tail awareness contrastive learning for distantly supervised relation extraction

Exploring Long Tail Data in Distantly Supervised Relation Extraction

A Long-Tail Relation Extraction Model Based on Dependency Path and Relation Graph Embedding

Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extraction

Cross-Relation Cross-Bag Attention for Distantly-Supervised Relation Extraction.

Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks.

Learning Relation Prototype from Unlabeled Texts for Long-Tail Relation Extraction

Distantly Supervised Relation Extraction Based on Residual Attention and Self Learning

Diverse classifiers with label dependencies for long-tail relation extraction in big data

Transfer Learning for Relation Extraction Via Relation-Gated Adversarial Learning

Improving Long-Tail Relation Extraction Via Adaptive Adjustment and Causal Inference

Distant Supervised Relation Extraction on Pre-train Model with Improved Multi-label Attention Mechanism

Self-selective Attention Using Correlation Between Instances for Distant Supervision Relation Extraction.

Auxiliary Learning for Relation Extraction.

HCL: A Hierarchical Contrastive Learning Framework for Zero-Shot Relation Extraction

HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction

Piecewise convolutional neural networks with position attention and similar bag attention for distant supervision relation extraction

Distantly-Supervised Long-Tailed Relation Extraction Using Constraint Graphs

MixCL: Mixed Contrastive Learning for Relation Extraction

Distant Supervision for Relation Extraction with Hierarchical Selective Attention.

Towards Time-Aware Distant Supervision for Relation Extraction