Enhancing Relation Classification Using Focal Loss

Yuqi Yuan,Xiong Luo,Qiaojuan Peng,Maojian Chen,Hailun Shen,Ziyang Huang
DOI: https://doi.org/10.1109/cac57257.2022.10055561
2022-01-01
Abstract:Relation classification (RC) is becoming an increasingly significant subject in natural language processing. However, the public datasets suffer from the problem of class imbalance, which limits the performance and generalizability of the model. In this paper, we propose an approach that integrates the bidirectional encoder representation from transformers (BERT) model with focal loss to alleviate the influence of the class imbalance problem in RC datasets. By this way, the model can decrease the contribution of high-frequency instances and easy instances during training, allowing the model to rapidly concentrate on low-frequency instances and hard instances. As a consequence, experiments on the SemEval-2010 Task 8 benchmark dataset indicate that our method achieves a considerable advance above the previous methods, with a Macro-F1 score of 90.62%.
What problem does this paper attempt to address?