Abstract:High-accuracy parameter learning in Bayesian Networks (BNs) is a key challenge in real-time decision support applications, particularly when the available data are limited. Prior/Expert knowledge was introduced to eliminate the drawbacks of insufficient information; however, this method is subjective. In this study, we explored the use of monotonicity constraints to control the causal relationships between the nodes and their parents-nodes in BNs and proposed a new learning algorithm called global domain monotonicity based on maximum information entropy (GDM-MIE), which was designed for parameter learning in uncertain discrete BNs with nonlinear equality constraints when only finite data are available. In the proposed algorithm, a class of monotonicity is encoded as a constraint on information entropy and the parameter learning problem is transformed into constraints among the node parameters based on a known network. Furthermore, we considered the parameters as uncertain entropy information and discussed the monotonicity among parameters in the global spatial domain, proving the accuracy of the logical relationships of the model, system reliability, and time complexity. Finally, the proposed method was validated using standard BNs, and its performance was analyzed by comparing the proposed method with the existing learning algorithms. The results showed that the proposed method is more accurate and has better Kullback–Leibler divergence. To revalidate the rationality of the proposed method, the Alarm and Asia networks were employed as special cases. The GDM-MIE was found to achieve the intended goal of observing the estimated parameters by closely approximating the original real parameters with a small sample size, indicating that the proposed algorithm can served as an efficient and feasible method for learning Bayesian parameter.

Bayesian Network Approach to Multinomial Parameter Learning Using Data and Expert Judgments.

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Bayesian Network Parameter Learning Using Constraint-Based Data Extension Method

An Extended Mpl-C Model For Bayesian Network Parameter Learning With Exterior Constraints

Bayesian Network Parameter Learning with Constraint Balance

Learning Bayesian Networks by Constrained Bayesian Estimation

An Empirical Study of Bayesian Network Parameter Learning with Monotonic Influence Constraints

Incorporating Expert Judgement into Bayesian Network Machine Learning.

A Mixed Bayesian Network for Two-Dimensional Decision Modeling of Departure Time and Mode Choice

Probabilistic Graphical Models Parameter Learning With Transferred Prior And Constraints

Bayesian network parameter learning using fuzzy constraints.

Learning Bayesian Network Parameters from Limited Data by Integrating Entropy and Monotonicity

Learning Bayesian Networks Using the Constrained Maximum a Posteriori Probability Method

Learning Bayesian Network Parameters from Small Data Set: A Spatially Maximum a Posteriori Method.

Bayesian networks structure learning based on improved BIC scoring

Learning Bayesian Network Parameters under Dual Constraints from Small Data Set

Learning Bayesian network parameters from small data set:an adaptive method

An Improved Constraint-Based Bayesian Network Learning Method Using Gaussian Kernel Probability Density Estimator.

Learning Bayesian Network Parameters Via Minimax Algorithm

A Novel BN Learning Algorithm Based on Block Learning Strategy

An Efficient Approach for Parameters Learning of Bayesian Network with Multiple Latent Variables Using Neural Networks and P-EM