Abstract:In attempts to produce ML models less reliant on spurious patterns in NLP datasets, researchers have recently proposed curating counterfactually augmented data (CAD) via a human-in-the-loop process in which given some documents and their (initial) labels, humans must revise the text to make a counterfactual label applicable. Importantly, edits that are not necessary to flip the applicable label are prohibited. Models trained on the augmented data appear, empirically, to rely less on semantically irrelevant words and to generalize better out of domain. While this work draws loosely on causal thinking, the underlying causal model (even at an abstract level) and the principles underlying the observed out-of-domain improvements remain unclear. In this paper, we introduce a toy analog based on linear Gaussian models, observing interesting relationships between causal models, measurement noise, out-of-domain generalization, and reliance on spurious signals. Our analysis provides some insights that help to explain the efficacy of CAD. Moreover, we develop the hypothesis that while adding noise to causal features should degrade both in-domain and out-of-domain performance, adding noise to non-causal features should lead to relative improvements in out-of-domain performance. This idea inspires a speculative test for determining whether a feature attribution technique has identified the causal spans. If adding noise (e.g., by random word flips) to the highlighted spans degrades both in-domain and out-of-domain performance on a battery of challenge datasets, but adding noise to the complement gives improvements out-of-domain, it suggests we have identified causal spans. We present a large-scale empirical study comparing spans edited to create CAD to those selected by attention and saliency maps. Across numerous domains and models, we find that the hypothesized phenomenon is pronounced for CAD.

Extended-AUDI method for simultaneous determination of causality and models from process data

Simultaneous Identification of Bidirectional Path Models Based on Process Data

Spatial-Temporal Causality Modeling for Industrial Processes with a Knowledge-Data Guided Reinforcement Learning

An Extended AUDI Algorithm for Simultaneous Identification of Forward and Backward Paths in Closed-Loop Systems

A Fault Prognosis Strategy Based on Time-Delayed Digraph Model and Principal Component Analysis

An Augmented Ud Identification Algorithm

A Novel Dynamic Baysian Canonical Correlation Analysis Method for Fault Detection

Recursive Mixture Factor Analyzer for Monitoring Multimode Time-Variant Industrial Processes

Neural Network Weight Comparison for Industrial Causality Discovering and Its Soft Sensing Application

Capturing Causality from Process Data

Data-driven Dynamic Inferential Sensors Based on Causality Analysis

Causality Learning from Time Series Data for the Industrial Finance Analysis Via the Multi-dimensional Point Process

Multi-lag and multi-type temporal causality inference and analysis for industrial process fault diagnosis

Data-driven dynamic causality analysis of industrial systems using interpretable machine learning and process mining

A New Causal Direction Reasoning Method for Decision Making on Noisy Data

Combined cause inference: Definition, model and performance

iSCAN: Identifying Causal Mechanism Shifts among Nonlinear Additive Noise Models

A Liang-Kleeman Causality Analysis based on Linear Inverse Modeling

Using causal inference to avoid fallouts in data-driven parametric analysis: a case study in the architecture, engineering, and construction industry

Decision-making Modeling Method Based on Artificial Neural Network and Data Envelopment Analysis

Explaining The Efficacy of Counterfactually Augmented Data