Contrastive Learning-Based Few-Shot Relation Extraction with Open-Book Datastore

Wanyuan Gong,Qifeng Zhou
DOI: https://doi.org/10.1016/j.asoc.2024.112302
2024-01-01
Abstract:Few-shot relation extraction (FSRE) aims to identify relations with the aid of few instances. In real-world application scenarios, users often encounter new entities or relations, and there is insufficient labeled data to train the model, making FSRE particularly important. However, limited by the quality of instances in real-world settings, FSRE struggles to discern the subtle semantic differences among instances and corresponding relations. This leads to the critical problem of effectively learning these semantic differences of similar instances and similar relations effectively. In this paper, we propose a novel F ew-Shot C ontrastive L earning (FSCL) framework to alleviate the semantics challenges of similar instances and relations. To learn the semantic information in low-resource environments, FSCL jointly utilizes contrastive learning with an open-book datastore, while updating the instance representations in the open-book datastore asynchronously. To further enhance the robustness and reduce the impact of semantic bias caused by contrastive learning, we explore six data augmentation strategies on three public datasets to capture more meaningful semantic distinctions among instances as well as their relations. By conducting data augmentation experiments, we find that dropout noise is an effective strategy for data augmentation that can significantly highlight semantic differences between similar instances when learning similar relational representations. This helps the model obtain more potent and meaningful representations. Experiments on five public datasets demonstrate the effectiveness of the proposed method. Our codes are available on https://github.com/JohnnyGWY/FSCL.
What problem does this paper attempt to address?