Abstract:In Bayesian network structure learning, the quality of the directed graph learned by the constraint-based approaches can be greatly affected by the order of choosing variable pairs and the order of selecting condition sets for testing conditional independence. Inspired by the strong connection between the degree of mutual information shared by two variables and their conditional independence, we introduce the M-ordering concept, where a matrix is precomputed from the observational data with variables ordered increasingly by their respective degree of mutual information with the target variable under concern. Given the M-ordering matrix, we propose a strategy called Weakest Mutual-Information-First Strategy (WMIF), which is integrated into the PC-algorithm in two aspects: an MI-based edge removal strategy, and an MI-based condition set generation strategy. The MI-based edge removal strategy is to always select the variable pair with the weakest mutual information to test their conditional independence; the condition set generation strategy is to construct a conditioning set where variables bearing a weaker degree of mutual information with the target variable are always considered first. We prove that the weakest MI-based edge removal strategy is sound, and our PC-MI algorithm, a PC variant empowered by the WMIF strategy, is order-independent. Moreover, in PC algorithms, the number of conditional independence tests increases exponentially with the number of random variables; we show that the WMIF strategy can effectively reduce the complexity (bounded by o ( | V | ( 2 | a d j ( X ) | − | V | 2 2 ) )). We have conducted experiments with both low-dimensional and high-dimensional data sets, and the results indicate that PC-MI outperforms the state-of-the-art approaches. More importantly, the order-agnostic property of PC-MI can be extremely useful when it is hard to prescribe a meaningful variable ordering as needed in some other PC algorithms.

Grouping Parallel Bayesian Network Structure Learning Algorithm Based on Variable Ordering

The impact of variable ordering on Bayesian network structure learning

A Parallel Algorithm for Exact Bayesian Structure Discovery in Bayesian Networks

Learning directed acyclic graphs based on sparsest permutations

Quantum Speedups for Bayesian Network Structure Learning

Learning the structure of Bayesian networks with ancestral and/or heuristic partition

An Efficient Procedure for Computing Bayesian Network Structure Learning

Learning Structures of Bayesian Networks for Variable Groups

Learning Bayesian Network Structures Using Weakest Mutual-Information-first Strategy

A Multi-Granularity Information-Based Method for Learning High-Dimensional Bayesian Network Structures

Improved Population-Based Incremental Learning of Bayesian Networks with partly known structure and parallel computing

Efficient and Scalable Structure Learning for Bayesian Networks: Algorithms and Applications

Bayesian Network Structure Learning Using Quantum Annealing

Improved K2 algorithm for Bayesian network structure learning

An efficient Bayesian network structure learning algorithm based on structural information

A survey of Bayesian Network structure learning

Research On Learning Bayesian Network Structure With Hidden Variables Based On Genetic Algorithms

An Improved Particle Swarm Optimization Algorithm for Bayesian Network Structure Learning via Local Information Constraint

Divide-and-Conquer Strategy for Large-Scale Dynamic Bayesian Network Structure Learning

Learning causal graphs using variable grouping according to ancestral relationship