Abstract:High-accuracy parameter learning in Bayesian Networks (BNs) is a key challenge in real-time decision support applications, particularly when the available data are limited. Prior/Expert knowledge was introduced to eliminate the drawbacks of insufficient information; however, this method is subjective. In this study, we explored the use of monotonicity constraints to control the causal relationships between the nodes and their parents-nodes in BNs and proposed a new learning algorithm called global domain monotonicity based on maximum information entropy (GDM-MIE), which was designed for parameter learning in uncertain discrete BNs with nonlinear equality constraints when only finite data are available. In the proposed algorithm, a class of monotonicity is encoded as a constraint on information entropy and the parameter learning problem is transformed into constraints among the node parameters based on a known network. Furthermore, we considered the parameters as uncertain entropy information and discussed the monotonicity among parameters in the global spatial domain, proving the accuracy of the logical relationships of the model, system reliability, and time complexity. Finally, the proposed method was validated using standard BNs, and its performance was analyzed by comparing the proposed method with the existing learning algorithms. The results showed that the proposed method is more accurate and has better Kullback–Leibler divergence. To revalidate the rationality of the proposed method, the Alarm and Asia networks were employed as special cases. The GDM-MIE was found to achieve the intended goal of observing the estimated parameters by closely approximating the original real parameters with a small sample size, indicating that the proposed algorithm can served as an efficient and feasible method for learning Bayesian parameter.

Optimizing the Topology of Bayesian Network Classifiers by Applying Conditional Entropy to Mine Causal Relationships Between Attributes

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Exploring Complex Multivariate Probability Distributions with Simple and Robust Bayesian Network Topology for Classification

Hierarchical Independence Thresholding for Learning Bayesian Network Classifiers.

A Novel Approach to Fully Representing the Diversity in Conditional Dependencies for Learning Bayesian Network Classifier

Stochastic Optimization for Bayesian Network Classifiers

From Undirected Dependence to Directed Causality: A Novel Bayesian Learning Approach

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Efficient Heuristics for Learning Bayesian Network from Labeled and Unlabeled Data

Learning High-Dependence Bayesian Network Classifier with Robust Topology

Comparing Bayesian Network Classifiers

Learning Causal Bayesian Networks Based on Causality Analysis for Classification

Learning Bayesian Network Parameters from Limited Data by Integrating Entropy and Monotonicity

Learning in a hybrid Bayesian network structure for causal analysis

Structure Learning of Bayesian Network Based on Adaptive Thresholding

Entropy and the Kullback-Leibler Divergence for Bayesian Networks: Computational Complexity and Efficient Implementation

Fast & Efficient Learning of Bayesian Networks from Data: Knowledge Discovery and Causality

Embedded Bayesian Network Classifiers

Exploiting the Implicit Independence Assumption for Learning Directed Graphical Models.

A Comprehensively Improved Hybrid Algorithm for Learning Bayesian Networks: Multiple Compound Memory Erasing