Abstract:Differentiable causal discovery has made significant advancements in the learning of directed acyclic graphs. However, its application to real-world datasets remains restricted due to the ubiquity of latent confounders and the requirement to learn maximal ancestral graphs (MAGs). To date, existing differentiable MAG learning algorithms have been limited to small datasets and failed to scale to larger ones (e.g., with more than 50 variables). The key insight in this paper is that the causal skeleton, which is the undirected version of the causal graph, has potential for improving accuracy and reducing the search space of the optimization procedure, thereby enhancing the performance of differentiable causal discovery. Therefore, we seek to address a two-fold challenge to harness the potential of the causal skeleton for differentiable causal discovery in the presence of latent confounders: (1) scalable and accurate estimation of skeleton and (2) universal integration of skeleton estimation with differentiable causal discovery. To this end, we propose SPOT (Skeleton Posterior-guided OpTimization), a two-phase framework that harnesses skeleton posterior for differentiable causal discovery in the presence of latent confounders. On the contrary to a ``point-estimation'', SPOT seeks to estimate the posterior distribution of skeletons given the dataset. It first formulates the posterior inference as an instance of amortized inference problem and concretizes it with a supervised causal learning (SCL)-enabled solution to estimate the skeleton posterior. To incorporate the skeleton posterior with differentiable causal discovery, SPOT then features a skeleton posterior-guided stochastic optimization procedure to guide the optimization of MAGs. [abridged due to length limit]

Skeleton Estimation of Directed Acyclic Graphs Using Partial Least Squares from Correlated Data.

Nonlinear Directed Acyclic Graph Estimation Based on the Kernel Partial Correlation Coefficient

Learning directed acyclic graphs based on sparsest permutations

Sparse Directed Acyclic Graphs Incorporating the Covariates

Efficient Learning of Nonparametric Directed Acyclic Graph with Statistical Guarantee

Adaptive Skeleton Construction for Accurate DAG Learning

A Novel Causal Discovery Method in Linear SEM with Structure Priors

High-Dimensional Poisson DAG Model Learning Using $\ell_1$-Regularized Regression

Learning Directed Acyclic Graphs from Partial Orderings

Directed Adaptive Graphical Lasso for causality inference.

Coordinated Multi-Neighborhood Learning on a Directed Acyclic Graph

High-Dimensional Joint Estimation of Multiple Directed Gaussian Graphical Models

Learning Local Directed Acyclic Graphs Based on Multivariate Time Series Data

A Metaheuristic Causal Discovery Method in Directed Acyclic Graphs Space

High dimensional sparse covariance estimation via directed acyclic graphs

Scalable Differentiable Causal Discovery in the Presence of Latent Confounders with Skeleton Posterior (Extended Version)

Personalized Binomial DAGs Learning with Network Structured Covariates

Structure Learning of Sparse Directed Acyclic Graphs Incorporating the Scale-Free Property

Partial Homoscedasticity in Causal Discovery with Linear Models

Efficient Learning of Quadratic Variance Function Directed Acyclic Graphs via Topological Layers

On Low Rank Directed Acyclic Graphs and Causal Structure Learning