Abstract:Causal reasoning and logical reasoning are two important types of reasoning abilities for human intelligence. However, their relationship has not been extensively explored under machine intelligence context. In this paper, we explore how the two reasoning abilities can be jointly modeled to enhance both accuracy and explainability of machine learning models. More specifically, by integrating two important types of reasoning ability -- counterfactual reasoning and (neural) logical reasoning -- we propose Counterfactual Collaborative Reasoning (CCR), which conducts counterfactual logic reasoning to improve the performance. In particular, we use recommender system as an example to show how CCR alleviate data scarcity, improve accuracy and enhance transparency. Technically, we leverage counterfactual reasoning to generate "difficult" counterfactual training examples for data augmentation, which -- together with the original training examples -- can enhance the model performance. Since the augmented data is model irrelevant, they can be used to enhance any model, enabling the wide applicability of the technique. Besides, most of the existing data augmentation methods focus on "implicit data augmentation" over users' implicit feedback, while our framework conducts "explicit data augmentation" over users explicit feedback based on counterfactual logic reasoning. Experiments on three real-world datasets show that CCR achieves better performance than non-augmented models and implicitly augmented models, and also improves model transparency by generating counterfactual explanations.

Combating Short Circuit Behavior in Natural Language Reasoning: Crossover and Mutation Operations for Enhanced Robustness

On Robustness and Bias Analysis of BERT-Based Relation Extraction

Reducing the Scope of Language Models with Circuit Breakers

Counterfactual Variable Control for Robust and Interpretable Question Answering

Understanding Prior Bias and Choice Paralysis in Transformer-based Language Representation Models through Four Experimental Probes

Focus on Your Question! Interpreting and Mitigating Toxic CoT Problems in Commonsense Reasoning

DKE-Research at SemEval-2024 Task 2: Incorporating Data Augmentation with Generative Models and Biomedical Knowledge to Enhance Inference Robustness

A Case Study of the Shortcut Effects in Visual Commonsense Reasoning

UNcommonsense Reasoning: Abductive Reasoning about Uncommon Situations

Break the Chain: Large Language Models Can be Shortcut Reasoners

Evaluating Commonsense in Pre-trained Language Models

Mitigating Reversal Curse in Large Language Models via Semantic-aware Permutation Training

Reasoning Beyond Bias: A Study on Counterfactual Prompting and Chain of Thought Reasoning

A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models

Counterfactual Collaborative Reasoning

Robust Commonsense Reasoning Against Noisy Labels Using Adaptive Correction

Improving Alignment and Robustness with Circuit Breakers

Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets

Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models

Certified Robustness Against Natural Language Attacks by Causal Intervention

Preemptive Answer "Attacks" on Chain-of-Thought Reasoning