Abstract:We consider the problem of learning a Bayesian network or directed acyclic graph (DAG) model from observational data. A number of constraint-based, score-based and hybrid algorithms have been developed for this purpose. For constraint-based methods, statistical consistency guarantees typically rely on the faithfulness assumption, which has been show to be restrictive especially for graphs with cycles in the skeleton. However, there is only limited work on consistency guarantees for score-based and hybrid algorithms and it has been unclear whether consistency guarantees can be proven under weaker conditions than the faithfulness assumption. In this paper, we propose the sparsest permutation (SP) algorithm. This algorithm is based on finding the causal ordering of the variables that yields the sparsest DAG. We prove that this new score-based method is consistent under strictly weaker conditions than the faithfulness assumption. We also demonstrate through simulations on small DAGs that the SP algorithm compares favorably to the constraint-based PC and SGS algorithms as well as the score-based Greedy Equivalence Search and hybrid Max-Min Hill-Climbing method. In the Gaussian setting, we prove that our algorithm boils down to finding the permutation of the variables with sparsest Cholesky decomposition for the inverse covariance matrix. Using this connection, we show that in the oracle setting, where the true covariance matrix is known, the SP algorithm is in fact equivalent to $\ell_0$-penalized maximum likelihood estimation.

Learning DAGs without imposing acyclicity

Learning directed acyclic graphs based on sparsest permutations

Non-negative Weighted DAG Structure Learning

Efficient Learning of Nonparametric Directed Acyclic Graph with Statistical Guarantee

$ψ$DAG: Projected Stochastic Approximation Iteration for DAG Structure Learning

DAG-GAN: Causal Structure Learning with Generative Adversarial Nets

Contextual Directed Acyclic Graphs

Integer Programming for Learning Directed Acyclic Graphs from Non-identifiable Gaussian Models

DAG-GNN: DAG Structure Learning with Graph Neural Networks

ExDAG: Exact learning of DAGs

Efficient Learning of Quadratic Variance Function Directed Acyclic Graphs via Topological Layers

Convolutional Learning on Directed Acyclic Graphs

Structural transfer learning of non-Gaussian DAG

ProDAG: Projection-Induced Variational Inference for Directed Acyclic Graphs

Learning Directed Acyclic Graphs from Partial Orderings

High-Dimensional Poisson DAG Model Learning Using $\ell_1$-Regularized Regression

A Recursive Method for Structural Learning of Directed Acyclic Graphs

Idag: Invariant DAG Searching for Domain Generalization

Global Optimality in Bivariate Gradient-based DAG Learning

Guided structure learning of DAGs for count data

On Low Rank Directed Acyclic Graphs and Causal Structure Learning