Abstract:Deep learning techniques have dominated the literature on aspect-based sentiment analysis (ABSA), achieving state-of-the-art performance. However, deep models generally suffer from spurious correlations between input features and output labels, which hurts the robustness and generalization capability by a large margin. In this paper, we propose to reduce spurious correlations for ABSA, via a novel Contrastive Variational Information Bottleneck framework (called CVIB). The proposed CVIB framework is composed of an original network and a self-pruned network, and these two networks are optimized simultaneously via contrastive learning. Concretely, we employ the Variational Information Bottleneck (VIB) principle to learn an informative and compressed network (self-pruned network) from the original network, which discards the superfluous patterns or spurious correlations between input features and prediction labels. Then, self-pruning contrastive learning is devised to pull together semantically similar positive pairs and push away dissimilar pairs, where the representations of the anchor learned by the original and self-pruned networks respectively are regarded as a positive pair while the representations of two different sentences within a mini-batch are treated as a negative pair. To verify the effectiveness of our CVIB method, we conduct extensive experiments on five benchmark ABSA datasets and the experimental results show that our approach achieves better performance than the strong competitors in terms of overall prediction performance, robustness, and generalization. Code and data to reproduce the results in this paper is available at: <a class="link-external link-https" href="https://github.com/shesshan/CVIB" rel="external noopener nofollow">this https URL</a>.

Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysis

Counterfactual-Enhanced Information Bottleneck for Aspect-Based Sentiment Analysis

Contrastive variational information bottleneck for aspect-based sentiment analysis

Aspect-invariant Sentiment Features Learning: Adversarial Multi-task Learning for Aspect-based Sentiment Analysis.

An Augmented Interpretive Framework Based on Aspect Sentiment Words Aggregation

On Gradient-like Explanation under a Black-box Setting: When Black-box Explanations Become as Good as White-box

Reducing Spurious Correlations in Aspect-based Sentiment Analysis with Explanation from Large Language Models.

Towards a Better Understanding of Gradient-Based Explanatory Methods in NLP.

End-to-End Aspect-Based Sentiment Analysis Based on IDCNN-BLSA Feature Fusion

A Simple Information-Based Approach to Unsupervised Domain-Adaptive Aspect-Based Sentiment Analysis

TimeX++: Learning Time-Series Explanations with Information Bottleneck

Explanation Bottleneck Models

IDGI: A Framework to Eliminate Explanation Noise from Integrated Gradients

A multi-aspect framework for explainable sentiment analysis

Towards Explanation for Unsupervised Graph-Level Representation Learning

Domain Level Interpretability: Interpreting Black-box Model with Domain-specific Embedding

Domain Level Interpretability: Interpreting Black-box Model with Domain-specific Embedding.

Effective inter-aspect words modeling for aspect-based sentiment analysis

Model Debiasing via Gradient-based Explanation on Representation

Let's Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models

Co-attention Network and Low-rank Bilinear Pooling for Aspect Based Sentiment Analysis