Abstract:In attempts to produce ML models less reliant on spurious patterns in NLP datasets, researchers have recently proposed curating counterfactually augmented data (CAD) via a human-in-the-loop process in which given some documents and their (initial) labels, humans must revise the text to make a counterfactual label applicable. Importantly, edits that are not necessary to flip the applicable label are prohibited. Models trained on the augmented data appear, empirically, to rely less on semantically irrelevant words and to generalize better out of domain. While this work draws loosely on causal thinking, the underlying causal model (even at an abstract level) and the principles underlying the observed out-of-domain improvements remain unclear. In this paper, we introduce a toy analog based on linear Gaussian models, observing interesting relationships between causal models, measurement noise, out-of-domain generalization, and reliance on spurious signals. Our analysis provides some insights that help to explain the efficacy of CAD. Moreover, we develop the hypothesis that while adding noise to causal features should degrade both in-domain and out-of-domain performance, adding noise to non-causal features should lead to relative improvements in out-of-domain performance. This idea inspires a speculative test for determining whether a feature attribution technique has identified the causal spans. If adding noise (e.g., by random word flips) to the highlighted spans degrades both in-domain and out-of-domain performance on a battery of challenge datasets, but adding noise to the complement gives improvements out-of-domain, it suggests we have identified causal spans. We present a large-scale empirical study comparing spans edited to create CAD to those selected by attention and saliency maps. Across numerous domains and models, we find that the hypothesized phenomenon is pronounced for CAD.

CD- NOTEARS: Concept Driven Causal Structure Learning Using NOTEARS

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Unsuitability of NOTEARS for Causal Graph Discovery

Directed Acyclic Graphs With Tears

On the Role of Entropy-based Loss for Learning Causal Structures with Continuous Optimization

Causal discovery using dynamically requested knowledge

CL-NOTEARS: Continuous Optimization Algorithm Based on Curriculum Learning Framework

DARING: Differentiable Causal Discovery with Residual Independence

Causal Structure Learning With One-Dimensional Convolutional Neural Networks

Causal Discovery from Incomplete Data using An Encoder and Reinforcement Learning

On Low Rank Directed Acyclic Graphs and Causal Structure Learning

Amortized Inference for Causal Structure Learning

Discovering Dynamic Causal Space for DAG Structure Learning

A hybrid constrained continuous optimization approach for optimal causal discovery from biological data

Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Data

Causal Structure Learning: a Combinatorial Perspective

A Sound and Complete Algorithm for Learning Causal Models from Relational Data

DAG-GAN: Causal Structure Learning with Generative Adversarial Nets

Mitigating Prior Errors in Causal Structure Learning: Towards LLM driven Prior Knowledge

Explaining The Efficacy of Counterfactually Augmented Data

LOCAL: Learning with Orientation Matrix to Infer Causal Structure from Time Series Data