A survey of Bayesian Network structure learning

Neville K. Kitson,Anthony C. Constantinou,Zhigao Guo,Yang Liu,Kiattikun Chobtham
DOI: https://doi.org/10.48550/arXiv.2109.11415
2022-10-26
Abstract:Bayesian Networks (BNs) have become increasingly popular over the last few decades as a tool for reasoning under uncertainty in fields as diverse as medicine, biology, epidemiology, economics and the social sciences. This is especially true in real-world areas where we seek to answer complex questions based on hypothetical evidence to determine actions for intervention. However, determining the graphical structure of a BN remains a major challenge, especially when modelling a problem under causal assumptions. Solutions to this problem include the automated discovery of BN graphs from data, constructing them based on expert knowledge, or a combination of the two. This paper provides a comprehensive review of combinatoric algorithms proposed for learning BN structure from data, describing 74 algorithms including prototypical, well-established and state-of-the-art approaches. The basic approach of each algorithm is described in consistent terms, and the similarities and differences between them highlighted. Methods of evaluating algorithms and their comparative performance are discussed including the consistency of claims made in the literature. Approaches for dealing with data noise in real-world datasets and incorporating expert knowledge into the learning process are also covered.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the challenges in Bayesian Networks (BNs) structure learning, especially when modeling problems under causal assumptions. Specifically, the paper focuses on how to automatically discover the graphical structure of BNs from data, which is particularly important when dealing with complex problems in the real world. These problems may involve determining interventions based on assumed evidence, for example, in fields such as medicine, biology, epidemiology, economics, and social sciences. By reviewing 74 combinatorial algorithms, covering prototype, established, and cutting - edge methods, the paper describes in detail the basic methods of each algorithm and emphasizes their similarities and differences. In addition, the paper also discusses the methods for evaluating these algorithms and their relative performance, including the consistency of the claims proposed in the literature. The paper also explores how to handle noise in real - world datasets and how to incorporate expert knowledge into the learning process. In summary, this paper aims to provide a comprehensive review to help researchers and practitioners better understand and apply BN structure learning techniques.