Abstract:Structure Learning for Bayesian network (BN) is an important problem with extensive research. It plays central roles in a wide variety of applications in Alibaba Group. However, existing structure learning algorithms suffer from considerable limitations in real-world applications due to their low efficiency and poor scalability. To resolve this, we propose a new structure learning algorithm LEAST, which comprehensively fulfills our business requirements as it attains high accuracy, efficiency and scalability at the same time. The core idea of LEAST is to formulate the structure learning into a continuous constrained optimization problem, with a novel differentiable constraint function measuring the acyclicity of the resulting graph. Unlike with existing work, our constraint function is built on the spectral radius of the graph and could be evaluated in near linear time w.r.t. the graph node size. Based on it, LEAST can be efficiently implemented with low storage overhead. According to our benchmark evaluation, LEAST runs 1-2 orders of magnitude faster than state-of-the-art method with comparable accuracy, and it is able to scale on BNs with up to hundreds of thousands of variables. In our production environment, LEAST is deployed and serves for more than 20 applications with thousands of executions per day. We describe a concrete scenario in a ticket booking service in Alibaba, where LEAST is applied to build a near real-time automatic anomaly detection and root error cause analysis system. We also show that LEAST unlocks the possibility of applying BN structure learning in new areas, such as large-scale gene expression data analysis and explainable recommendation system.

Bayesian Network Structure Learning: A Review

A survey of Bayesian Network structure learning

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

An efficient Bayesian network structure learning algorithm based on structural information

Study of Bayesian Network Structure Learning

Learning the Structure of Bayesian Networks: A Quantitative Assessment of the Effect of Different Algorithmic Schemes

Bayesian Structure Learning in Undirected Gaussian Graphical Models: Literature Review with Empirical Comparison

An Exploration of Structure Learning in Bayesian Networks

Advances in Bayesian network modelling: Integration of modelling technologies

Learning the Finer Things: Bayesian Structure Learning at the Instantiation Level

Fast & Efficient Learning of Bayesian Networks from Data: Knowledge Discovery and Causality

Efficient and Scalable Structure Learning for Bayesian Networks: Algorithms and Applications

Structure Learning for Hybrid Bayesian Networks

An efficient skeleton learning approach-based hybrid algorithm for identifying Bayesian network structure

A Multi-Granularity Information-Based Method for Learning High-Dimensional Bayesian Network Structures

PSL: An Algorithm for Partial Bayesian Network Structure Learning

Biological Network Inference With GRASP: A Bayesian Network Structure Learning Method Using Adaptive Sequential Monte Carlo

Bayesian Network Structure Learning Using Chaos Hybrid Genetic Algorithm

Development and validation of a model that estimates body fat percentage based on simple anthropometric measurements.

Bayesian networks in neuroscience: a survey

Local Structure Discovery in Bayesian Networks