Abstract:Additive Noise Models (ANMs) are a common model class for causal discovery from observational data and are often used to generate synthetic data for causal discovery benchmarking. Specifying an ANM requires choosing all parameters, including those not fixed by explicit assumptions. Reisach et al. (2021) show that sorting variables by increasing variance often yields an ordering close to a causal order and introduce var-sortability to quantify this alignment. Since increasing variances may be unrealistic and are scale-dependent, ANM data are often standardized in benchmarks. We show that synthetic ANM data are characterized by another pattern that is scale-invariant: the explainable fraction of a variable's variance, as captured by the coefficient of determination $R^2$, tends to increase along the causal order. The result is high $R^2$-sortability, meaning that sorting the variables by increasing $R^2$ yields an ordering close to a causal order. We propose an efficient baseline algorithm termed $R^2$-SortnRegress that exploits high $R^2$-sortability and that can match and exceed the performance of established causal discovery algorithms. We show analytically that sufficiently high edge weights lead to a relative decrease of the noise contributions along causal chains, resulting in increasingly deterministic relationships and high $R^2$. We characterize $R^2$-sortability for different simulation parameters and find high values in common settings. Our findings reveal high $R^2$-sortability as an assumption about the data generating process relevant to causal discovery and implicit in many ANM sampling schemes. It should be made explicit, as its prevalence in real-world data is unknown. For causal discovery benchmarking, we implement $R^2$-sortability, the $R^2$-SortnRegress algorithm, and ANM simulation procedures in our library CausalDisco at <a class="link-external link-https" href="https://causaldisco.github.io/CausalDisco/" rel="external noopener nofollow">this https URL</a>.

Causal Identification with Additive Noise Models: Quantifying the Effect of Noise

The Effect of Noise Level on Causal Identification with Additive Noise Models

Causal Inference for Mixed-Type Data in Additive Noise Models.

Conditionally-additive-noise Models for Structure Learning

iSCAN: Identifying Causal Mechanism Shifts among Nonlinear Additive Noise Models

Cause-Effect Inference in Location-Scale Noise Models: Maximum Likelihood vs. Independence Testing

Assessing the overall and partial causal well-specification of nonlinear additive noise models

Identifiable Latent Neural Causal Models

Causal Discovery with Score Matching on Additive Models with Arbitrary Noise

Identification of Causal Structure in the Presence of Missing Data with Additive Noise Model

Causal Structure Learning Algorithm Based on Partial Rank Correlation under Additive Noise Model

A Scale-Invariant Sorting Criterion to Find a Causal Order in Additive Noise Models

Least-Squares Independence Regression for Non-Linear Causal Inference under Non-Gaussian Noise

Combined cause inference: Definition, model and performance

Learning Mixtures of Unknown Causal Interventions

MissDAG: Causal discovery in the presence of missing data with continuous additive noise models

RoCA: A Robust Method to Discover Causal or Anticausal Relation by Noise Injection

HANM: Hierarchical Additive Noise Model for Many-to-One Causality Discovery

Causal Discovery with Mixed Linear and Nonlinear Additive Noise Models: A Scalable Approach

Private Causal Inference

Explaining The Efficacy of Counterfactually Augmented Data