Abstract:If $X,Y,Z$ denote sets of random variables, two different data sources may contain samples from $P_{X,Y}$ and $P_{Y,Z}$, respectively. We argue that causal discovery can help inferring properties of the `unobserved joint distributions' $P_{X,Y,Z}$ or $P_{X,Z}$. The properties may be conditional independences (as in `integrative causal inference') or also quantitative statements about dependences. More generally, we define a learning scenario where the input is a subset of variables and the label is some statistical property of that subset. Sets of jointly observed variables define the training points, while unobserved sets are possible test points. To solve this learning task, we infer, as an intermediate step, a causal model from the observations that then entails properties of unobserved sets. Accordingly, we can define the VC dimension of a class of causal models and derive generalization bounds for the predictions. Here, causal discovery becomes more modest and better accessible to empirical tests than usual: rather than trying to find a causal hypothesis that is `true' a causal hypothesis is {\it useful} whenever it correctly predicts statistical properties of unobserved joint distributions. This way, a sparse causal graph that omits weak influences may be more useful than a dense one (despite being less accurate) because it is able to reconstruct the full joint distribution from marginal distributions of smaller subsets. Within such a `pragmatic' application of causal discovery, some popular heuristic approaches become justified in retrospect. It is, for instance, allowed to infer DAGs from partial correlations instead of conditional independences if the DAGs are only used to predict partial correlations.

Causal discovery in heavy-tailed models

Causality and extremes

Causal Discovery of Linear Non-Gaussian Causal Models with Unobserved Confounding

Estimation and Inference of Extremal Quantile Treatment Effects for Heavy-Tailed Distributions

Nonlinear Causal Discovery for High-Dimensional Deterministic Data

Counterfactual Covariate Causal Discovery on Nonlinear Extremal Quantiles

Semiparametric Tail Index Regression

Differentiable Causal Discovery For Latent Hierarchical Causal Models

A linear non-Gaussian acyclic model for causal discovery.

Amortized Causal Discovery: Learning to Infer Causal Graphs from Time-Series Data

A Linear Non-Gaussian Acyclic Model for Causal Discovery

Reinterpreting causal discovery as the task of predicting unobserved joint statistics

Local likelihood estimation of complex tail dependence structures, applied to U.S. precipitation extremes

Identification of Causal Structure with Latent Variables Based on Higher Order Cumulants

Partial Homoscedasticity in Causal Discovery with Linear Models

A Copula-Based Approach to Modelling and Testing for Heavy-tailed Data with Bivariate Heteroscedastic Extremes

Causal Discovery in Multivariate Extremes with a Hydrological Analysis of Swiss River Discharges

Granger Causality in Extremes

Causal Discovery from Multiple Data Sets with Non-Identical Variable Sets

Identification of Linear Non-Gaussian Latent Hierarchical Structure.

Causal Discovery by Kernel Deviance Measures with Heterogeneous Transforms