Abstract:One of the hardest challenges in building a realistic Bayesian Network (BN) model is to construct the node probability tables (NPTs). Even with a fixed predefined model structure and very large amounts of relevant data, machine learning methods do not consistently achieve great accuracy compared to the ground truth when learning the NPT entries (parameters). Hence, it is widely believed that incorporating expert judgments can improve the learning process. We present a multinomial parameter learning method, which can easily incorporate both expert judgments and data during the parameter learning process. This method uses an auxiliary BN model to learn the parameters of a given BN. The auxiliary BN contains continuous variables and the parameter estimation amounts to updating these variables using an iterative discretization technique. The expert judgments are provided in the form of constraints on parameters divided into two categories: linear inequality constraints and approximate equality constraints. The method is evaluated with experiments based on a number of well-known sample BN models (such as Asia, Alarm and Hailfinder) as well as a real-world software defects prediction BN model. Empirically, the new method achieves much greater learning accuracy (compared to both state-of-the-art machine learning techniques and directly competing methods) with much less data. For example, in the software defects BN for a sample size of 20 (which would be considered difficult to collect in practice) when a small number of real expert constraints are provided, our method achieves a level of accuracy in parameter estimation that can only be matched by other methods with much larger sample sizes (320 samples required for the standard machine learning method, and 105 for the directly competing method with constraints).

Bayesian network parameter learning using fuzzy constraints.

Bayesian Network Parameter Learning Using Constraint-Based Data Extension Method

Bayesian Network Parameter Learning with Constraint Balance

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Learning Bayesian network parameters with soft-hard constraints

Learning Bayesian Networks Using the Constrained Maximum a Posteriori Probability Method

Learning Bayesian Network Parameters Via Minimax Algorithm

Learning Bayesian Networks by Constrained Bayesian Estimation

Learning Bayesian network parameters from small data set:an adaptive method

Static bayesian network parameter learning using constraints

Learning Bayesian Network Parameters from Small Data Sets: A Further Constrained Qualitatively Maximum a Posteriori Method

Learning Bayesian Network Parameters from Small Data Set: A Spatially Maximum a Posteriori Method.

Learning Bayesian Network Parameters under Dual Constraints from Small Data Set

An Empirical Study of Bayesian Network Parameter Learning with Monotonic Influence Constraints

Probabilistic Graphical Models Parameter Learning With Transferred Prior And Constraints

Bayesian Network Revision with Probabilistic Constraints

Learning Bayesian Networks Using A* Search with Ancestral Constraints

Learning Bayesian network parameters under new monotonic constraints#br#

A Novel Qualitative Maximum a Posteriori Estimation for Bayesian Network Parameters Based on Computing the Center Point of Constrained Parameter Regions

Bayesian Network Approach to Multinomial Parameter Learning Using Data and Expert Judgments.

Incorporating Path Constraints into Bayesian Network under the Sparse Parent Graph