Abstract:OBJECTIVES: Bayesian networks (BNs) are rapidly becoming a leading technology in applied Artificial Intelligence, with many applications in medicine. Both automated learning of BNs and expert elicitation have been used to build these networks, but the potentially more useful combination of these two methods remains underexplored. In this paper we examine a number of approaches to their combination when learning structure and present new techniques for assessing their results.METHODS AND MATERIALS: Using public-domain medical data, we run an automated causal discovery system, CaMML, which allows the incorporation of multiple kinds of prior expert knowledge into its search, to test and compare unbiased discovery with discovery biased with different kinds of expert opinion. We use adjacency matrices enhanced with numerical and colour labels to assist with the interpretation of the results. We present an algorithm for generating a single BN from a set of learned BNs that incorporates user preferences regarding complexity vs completeness. These techniques are presented as part of the first detailed workflow for hybrid structure learning within the broader knowledge engineering process.RESULTS: The detailed knowledge engineering workflow is shown to be useful for structuring a complex iterative BN development process. The adjacency matrices make it clear that for our medical case study using the IOWA dataset, the simplest kind of prior information (partially sorting variables into tiers) was more effective in aiding model discovery than either using no prior information or using more sophisticated and detailed expert priors. The method for generating a single BN captures relationships that would be overlooked by other approaches in the literature.CONCLUSION: Hybrid causal learning of BNs is an important emerging technology. We present methods for incorporating it into the knowledge engineering process, including visualisation and analysis of the learned networks.

Incorporating Expert Judgement into Bayesian Network Machine Learning.

Bayesian Network Approach to Multinomial Parameter Learning Using Data and Expert Judgments.

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Bayesian Network Parameter Learning Using Constraint-Based Data Extension Method

Learning Gaussian Networks

Learning Bayesian Networks by Constrained Bayesian Estimation

Bayesian network parameter learning using fuzzy constraints.

An Empirical Study of Bayesian Network Parameter Learning with Monotonic Influence Constraints

An Extended Mpl-C Model For Bayesian Network Parameter Learning With Exterior Constraints

Learning Bayesian Networks Using the Constrained Maximum a Posteriori Probability Method

Bayesian Network Parameter Learning with Constraint Balance

Bayesian networks structure learning based on improved BIC scoring

Probabilistic Graphical Models Parameter Learning With Transferred Prior And Constraints

Learning Bayesian Network Parameters from Limited Data by Integrating Entropy and Monotonicity

Incorporating Experts' Judgment into Machine Learning Models

Integrating Expert Knowledge for Bayesian Network Structure Learning Based on Intuitionistic Fuzzy Set and Genetic Algorithm

Learning Bayesian Network Parameters from Small Data Set: A Spatially Maximum a Posteriori Method.

Incorporating expert knowledge when learning Bayesian network structure: A medical case study

Learning Bayesian Network Parameters Via Minimax Algorithm

Learning Bayesian network parameters from small data set:an adaptive method

Learning Bayesian network parameters under new monotonic constraints#br#