Abstract:If $X,Y,Z$ denote sets of random variables, two different data sources may contain samples from $P_{X,Y}$ and $P_{Y,Z}$, respectively. We argue that causal discovery can help inferring properties of the `unobserved joint distributions' $P_{X,Y,Z}$ or $P_{X,Z}$. The properties may be conditional independences (as in `integrative causal inference') or also quantitative statements about dependences. More generally, we define a learning scenario where the input is a subset of variables and the label is some statistical property of that subset. Sets of jointly observed variables define the training points, while unobserved sets are possible test points. To solve this learning task, we infer, as an intermediate step, a causal model from the observations that then entails properties of unobserved sets. Accordingly, we can define the VC dimension of a class of causal models and derive generalization bounds for the predictions. Here, causal discovery becomes more modest and better accessible to empirical tests than usual: rather than trying to find a causal hypothesis that is `true' a causal hypothesis is {\it useful} whenever it correctly predicts statistical properties of unobserved joint distributions. This way, a sparse causal graph that omits weak influences may be more useful than a dense one (despite being less accurate) because it is able to reconstruct the full joint distribution from marginal distributions of smaller subsets. Within such a `pragmatic' application of causal discovery, some popular heuristic approaches become justified in retrospect. It is, for instance, allowed to infer DAGs from partial correlations instead of conditional independences if the DAGs are only used to predict partial correlations.

A theoretical study of Y structures for causal discovery

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Causal Discovery in Linear Structural Causal Models with Deterministic Relations

Learning causal structures using hidden compact representation

Causal Discovery over High-Dimensional Structured Hypothesis Spaces with Causal Graph Partitioning

Causal Discovery under Latent Class Confounding

Modeling and Discovering Direct Causes for Predictive Models

Learning Causal Structures Based on Divide and Conquer

Confidence in Causal Discovery with Linear Causal Models

Directed Cyclic Graph for Causal Discovery from Multivariate Functional Data

Reliable Causal Discovery with Improved Exact Search and Weaker Assumptions

Score matching through the roof: linear, nonlinear, and latent variables causal discovery

Sample, estimate, aggregate: A recipe for causal discovery foundation models

Induced Covariance for Causal Discovery in Linear Sparse Structures

Causal Structure Learning Based on Genetic Algorithm and Markov Blanket

Bivariate Causal Discovery using Bayesian Model Selection

Amortized Inference for Causal Structure Learning

Reinterpreting causal discovery as the task of predicting unobserved joint statistics

A Full DAG Score-Based Algorithm for Learning Causal Bayesian Networks with Latent Confounders

Nonlinearity, Feedback and Uniform Consistency in Causal Structural Learning

A Genetic Algorithm for Causal Discovery Based on Structural Causal Model.