Abstract:Few-shot relation extraction (FSRE) aims to predict the relation for a pair of entities in a sentence by exploring a few labeled instances for each relation type. Current methods mainly rely on meta-learning to learn generalized representations by optimizing the network parameters based on various collections of tasks sampled from training data. However, these methods may suffer from two main issues. 1) Insufficient Supervision of meta-learning to learn discriminative representations on very few training instances, which are sampled from a large amount of base class data. 2) Spurious Correlations between entities and relation types due to the biased training procedure that focuses more on entity pair rather than context. To learn more discriminative and unbiased representations for FSRE, this paper proposes a two-stage approach via supervised contrastive learning and sentence- and entity-level prototypical networks. In the first (pre-training) stage, we introduce a supervised contrastive pre-training method, which is able to yield more discriminative representations by learning from the entire training instances, such that the semantically related representations are close to each other, and far away otherwise. In the second (meta-learning) stage, we propose a novel sentence- and entity-level prototypical network equipped with fine-grained feature-wise fusion strategy to learn unbiased representations, where the networks are initialized with the parameters trained in the first stage. Specifically, the proposed network consists of a sentence branch and an entity branch, taking entire sentences and entity mentions as inputs, respectively. The entity branch explicitly captures the correlation between entity pairs and relations, and then dynamically adjusts the sentence branch's prediction distributions. By doing so, the Spurious Correlations issue caused by biased training samples can be properly mitigated. Extensive experiments on two FSRE benchmarks demonstrate the effectiveness of our approach.

Towards Hard Few-Shot Relation Classification

Exploring Task Difficulty for Few-Shot Relation Extraction

Adaptive Prototypical Networks With Label Words and Joint Representation Learning for Few-Shot Relation Classification

Improved Few-Shot Learning for Images Classification

Enhancing Prototype Networks for Relation Classification with Multi-Feature and Confusing Loss Function in Low-resource Scenarios

Learning Discriminative and Unbiased Representations for Few-Shot Relation Extraction

Enhance Prototypical Networks with Hybrid Attention and Confusing Loss Function for Few-Shot Relation Classification

Few-shot Relation Classification Based on the BERT Model, Hybrid Attention and Fusion Networks

Large Margin Prototypical Network for Few-shot Relation Classification with Fine-grained Features

Survey of Few-Shot Relation Classification

Hybrid Attention-Based Prototypical Networks for Noisy Few-Shot Relation Classification.

FewRel 2.0: Towards More Challenging Few-Shot Relation Classification

Boosting Knowledge Base Automatically via Few-Shot Relation Classification

Few-shot Relation Classification Using Clustering-Based Prototype Modification.

Revisiting Few-shot Relation Classification: Evaluation Data and Classification Schemes

Multi-Channel Convolutional Neural Networks with Adversarial Training for Few-Shot Relation Classification (student Abstract)

Function-words Adaptively Enhanced Attention Networks for Few-Shot Inverse Relation Classification.

Sample Feature Enhancement Model Based on Heterogeneous Graph Representation Learning for Few-shot Relation Classification

Learning to Compare: Relation Network for Few-Shot Learning

Task-Aware Feature Composition for Few-Shot Relation Classification