Abstract:Structure Learning for Bayesian network (BN) is an important problem with extensive research. It plays central roles in a wide variety of applications in Alibaba Group. However, existing structure learning algorithms suffer from considerable limitations in real-world applications due to their low efficiency and poor scalability. To resolve this, we propose a new structure learning algorithm LEAST, which comprehensively fulfills our business requirements as it attains high accuracy, efficiency and scalability at the same time. The core idea of LEAST is to formulate the structure learning into a continuous constrained optimization problem, with a novel differentiable constraint function measuring the acyclicity of the resulting graph. Unlike with existing work, our constraint function is built on the spectral radius of the graph and could be evaluated in near linear time w.r.t. the graph node size. Based on it, LEAST can be efficiently implemented with low storage overhead. According to our benchmark evaluation, LEAST runs 1-2 orders of magnitude faster than state-of-the-art method with comparable accuracy, and it is able to scale on BNs with up to hundreds of thousands of variables. In our production environment, LEAST is deployed and serves for more than 20 applications with thousands of executions per day. We describe a concrete scenario in a ticket booking service in Alibaba, where LEAST is applied to build a near real-time automatic anomaly detection and root error cause analysis system. We also show that LEAST unlocks the possibility of applying BN structure learning in new areas, such as large-scale gene expression data analysis and explainable recommendation system.

An Efficient Bayesian Network Structure Learning Algorithm Using the Strategy of Two-Stage Searches.

An Improved Particle Swarm Optimization Algorithm for Bayesian Network Structure Learning via Local Information Constraint

An efficient Bayesian network structure learning algorithm based on structural information

An efficient skeleton learning approach-based hybrid algorithm for identifying Bayesian network structure

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Bayesian Network Structure Learning Using Chaos Hybrid Genetic Algorithm

An Efficient Procedure for Computing Bayesian Network Structure Learning

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Learning in a hybrid Bayesian network structure for causal analysis

A Comprehensively Improved Hybrid Algorithm for Learning Bayesian Networks: Multiple Compound Memory Erasing

Improved Local Search with Momentum for Bayesian Networks Structure Learning

Bayesian Network Structure Learning Based on Hybrid Differential Evolution and Bee Colony Algorithm

Feature Selection for Efficient Local-to-Global Bayesian Network Structure Learning

Learning Bayesian Network Structures with Discrete Particle Swarm Optimization Algorithm

A survey of Bayesian Network structure learning

An Experimental Comparison of Hybrid Algorithms for Bayesian Network Structure Learning

Markov blanket-embedded PSO algorithm for Bayesian network structure learning

Improved Population-Based Incremental Learning of Bayesian Networks with partly known structure and parallel computing

Learning the structure of Bayesian networks with ancestral and/or heuristic partition

Efficient and Scalable Structure Learning for Bayesian Networks: Algorithms and Applications

Partitioned hybrid learning of Bayesian network structures