DINER: Debiasing Aspect-based Sentiment Analysis with Multi-variable Causal Inference

Jialong Wu,Linhai Zhang,Deyu Zhou,Guoqiang Xu

2024-06-06

Abstract:Though notable progress has been made, neural-based aspect-based sentiment analysis (ABSA) models are prone to learn spurious correlations from annotation biases, resulting in poor robustness on adversarial data transformations. Among the debiasing solutions, causal inference-based methods have attracted much research attention, which can be mainly categorized into causal intervention methods and counterfactual reasoning methods. However, most of the present debiasing methods focus on single-variable causal inference, which is not suitable for ABSA with two input variables (the target aspect and the review). In this paper, we propose a novel framework based on multi-variable causal inference for debiasing ABSA. In this framework, different types of biases are tackled based on different causal intervention methods. For the review branch, the bias is modeled as indirect confounding from context, where backdoor adjustment intervention is employed for debiasing. For the aspect branch, the bias is described as a direct correlation with labels, where counterfactual reasoning is adopted for debiasing. Extensive experiments demonstrate the effectiveness of the proposed method compared to various baselines on the two widely used real-world aspect robustness test set datasets.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

The paper primarily addresses the bias issues present in Aspect-Based Sentiment Analysis (ABSA). Specifically, it focuses on the problem where neural network models tend to learn annotation biases when handling ABSA tasks, which leads to poor performance when faced with data transformations, especially when the target sentiment is reversed, causing a significant drop in accuracy.

To solve the aforementioned issues, the authors propose a new framework named DINER, which is based on multivariable causal inference to reduce bias in ABSA. DINER mainly addresses two types of biases: first, the direct correlation between the target aspect and the label; second, the indirect confusion between the target sentiment words and other non-target content in the review. To address these biases, the paper employs different causal intervention methods:

1. **For the review branch**, the backdoor adjustment intervention method is used to alleviate the indirect confusion between the target sentiment words and the context in the review;
2. **For the aspect branch**, counterfactual reasoning is used to eliminate the direct correlation between the target and the label.

The paper demonstrates the effectiveness of the proposed framework through experiments on two widely used real-world datasets, showing significant improvements compared to baseline methods. Additionally, the paper provides a detailed description of the experimental setup, implementation details, and evaluation results, showcasing the performance enhancement of DINER under different task variants.

In summary, the goal of this paper is to improve the robustness and accuracy of ABSA models by using multivariable causal inference techniques, particularly in situations that are prone to annotation bias.