Abstract:Recently, researchers have argued that the impressive performance of Natural Language Inference (NLI) models is highly due to the spurious correlations existing in training data, which makes models vulnerable and poorly generalized. Some work has made preliminary debiased attempts by developing data-driven interventions or model-level debiased learning. Despite the progress, existing debiased methods either suffered from the high cost of data annotation processing, or required elaborate design to identify biased factors. By conducting detailed investigations and data analysis, we argue that label information can provide meaningful guidance to identify these spurious correlations in training data, which has not been paid enough attention. Thus, we design a novel Label-aware Debiased Causal Reasoning Network (LDCRN). Specifically, according to the data analysis, we first build a causal graph to describe causal relations and spurious correlations in NLI. Then, we employ an NLI model (e.g., RoBERTa) to calculate total causal effect of input sentences to labels. Meanwhile, we design a novel label-aware biased module to model spurious correlations and calculate their causal effect in a fine-grained manner. The debiasing process is realized by subtracting this causal effect from total causal effect. Finally, extensive experiments over two well-known NLI datasets and multiple human-annotated challenging test sets are conducted to prove the superiority of LDCRN. Moreover, we have developed novel challenging test sets based on MultiNLI to facilitate the community.

Inversive-Reasoning Augmentation for Natural Language Inference.

Improving the Natural Language Inference robustness to hard dataset by data augmentation and preprocessing

Relation-based Counterfactual Data Augmentation and Contrastive Learning for Robustifying Natural Language Inference Models

Multi-Perspective Inferrer: Reasoning Sentences Relationship from Holistic Perspective

Lost in Inference: Rediscovering the Role of Natural Language Inference for Large Language Models

Natural Language Inference Using Lstm Model With Sentence Fusion

Research on judgment reasoning using natural language inference in Chinese medical texts

ANLIzing the Adversarial Natural Language Inference Dataset

Label-aware Debiased Causal Reasoning for Natural Language Inference

An Empirical Study on Model-agnostic Debiasing Strategies for Robust Natural Language Inference.

Abductive natural language inference by interactive model with structural loss

Asynchronous Deep Interaction Network for Natural Language Inference.

Which Spurious Correlations Impact Reasoning in NLI Models? A Visual Interactive Diagnosis through Data-Constrained Counterfactuals

Natural Language Inference with External Knowledge.

Discourse Marker Augmented Network with Reinforcement Learning for Natural Language Inference.

Transforming Question Answering Datasets Into Natural Language Inference Datasets

Mitigating Annotation Artifacts in Natural Language Inference Datasets to Improve Cross-dataset Generalization Ability

Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition

Debiasing NLU Models via Causal Intervention and Counterfactual Reasoning

Interactive Model with Structural Loss for Language-based Abductive Reasoning

HypoNLI: Exploring the Artificial Patterns of Hypothesis-only Bias in Natural Language Inference