Abstract:In recent years a lot of research has been conducted within the area of causal inference and causal learning. Many methods have been developed to identify the cause-effect pairs in models and have been successfully applied to observational real-world data in order to determine the direction of causal relationships. Many of these methods require simplifying assumptions, such as absence of confounding, cycles, and selection bias. Yet in bivariate situations causal discovery problems remain challenging. One class of such methods, that also allows tackling the bivariate case, is based on Additive Noise Models (ANMs). Unfortunately, one aspect of these methods has not received much attention until now: what is the impact of different noise levels on the ability of these methods to identify the direction of the causal relationship. This work aims to bridge this gap with the help of an empirical study. For this work, we considered bivariate cases, which is the most elementary form of a causal discovery problem where one needs to decide whether X causes Y or Y causes X, given joint distributions of two variables X, Y. Furthermore, two specific methods have been selected, \textit{Regression with Subsequent Independence Test} and \textit{Identification using Conditional Variances}, which have been tested with an exhaustive range of ANMs where the additive noises' levels gradually change from 1% to 10000% of the causes' noise level (the latter remains fixed). Additionally, the experiments in this work consider several different types of distributions as well as linear and non-linear ANMs. The results of the experiments show that these methods can fail to capture the true causal direction for some levels of noise.

A New Causal Direction Reasoning Method for Decision Making on Noisy Data

Inferring Causal Directions from Uncertain Data

Causal Identification with Additive Noise Models: Quantifying the Effect of Noise

Reasoning of Causal Direction in Linear Model Based on Spearman's Rank Correlation Coefficient.

DARING: Differentiable Causal Discovery with Residual Independence

Recursively Learning Causal Structures Using Regression-based Conditional Independence Test

Causal Discovery with General Non-Linear Relationships Using Non-Linear ICA

Cause-Effect Inference in Location-Scale Noise Models: Maximum Likelihood vs. Independence Testing

The Effect of Noise Level on Causal Identification with Additive Noise Models

Causal Discovery on Discrete Data via Weighted Normalized Wasserstein Distance

Least-Squares Independence Regression for Non-Linear Causal Inference under Non-Gaussian Noise

Deep End-to-end Causal Inference

A Liang-Kleeman Causality Analysis based on Linear Inverse Modeling

Rhino: Deep Causal Temporal Relationship Learning With History-dependent Noise

Causal Inference with Non-IID Data under Model Uncertainty

Robust inference of causality in high-dimensional dynamical processes from the Information Imbalance of distance ranks

Hybrid Top-Down Global Causal Discovery with Local Search for Linear and Nonlinear Additive Noise Models

Effective Causal Discovery under Identifiable Heteroscedastic Noise Model

Playing against Nature: causal discovery for decision making under uncertainty

Causal-StoNet: Causal Inference for High-Dimensional Complex Data

Identification of Causal Structure in the Presence of Missing Data with Additive Noise Model