Abstract:OBJECTIVES: Bayesian networks (BNs) are rapidly becoming a leading technology in applied Artificial Intelligence, with many applications in medicine. Both automated learning of BNs and expert elicitation have been used to build these networks, but the potentially more useful combination of these two methods remains underexplored. In this paper we examine a number of approaches to their combination when learning structure and present new techniques for assessing their results.METHODS AND MATERIALS: Using public-domain medical data, we run an automated causal discovery system, CaMML, which allows the incorporation of multiple kinds of prior expert knowledge into its search, to test and compare unbiased discovery with discovery biased with different kinds of expert opinion. We use adjacency matrices enhanced with numerical and colour labels to assist with the interpretation of the results. We present an algorithm for generating a single BN from a set of learned BNs that incorporates user preferences regarding complexity vs completeness. These techniques are presented as part of the first detailed workflow for hybrid structure learning within the broader knowledge engineering process.RESULTS: The detailed knowledge engineering workflow is shown to be useful for structuring a complex iterative BN development process. The adjacency matrices make it clear that for our medical case study using the IOWA dataset, the simplest kind of prior information (partially sorting variables into tiers) was more effective in aiding model discovery than either using no prior information or using more sophisticated and detailed expert priors. The method for generating a single BN captures relationships that would be overlooked by other approaches in the literature.CONCLUSION: Hybrid causal learning of BNs is an important emerging technology. We present methods for incorporating it into the knowledge engineering process, including visualisation and analysis of the learned networks.

Data-Intensive Learning Of Uncertain Knowledge

Data-Intensive Inferences Of Large-Scale Bayesian Networks

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Massively parallel learning of Bayesian networks with MapReduce for factor relationship analysis

Scaling Bayesian Network Parameter Learning with Expectation Maximization using MapReduce

Learning the Finer Things: Bayesian Structure Learning at the Instantiation Level

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Fast & Efficient Learning of Bayesian Networks from Data: Knowledge Discovery and Causality

Information-Theoretic Scoring Rules to Learn Additive Bayesian Network Applied to Epidemiology

A New Method Of Learning Bayesian Networks Structures From Incomplete Data

Efficient Heuristics for Learning Bayesian Network from Labeled and Unlabeled Data

Efficient parameter learning for Bayesian Network classifiers following the Apache Spark Dataframes paradigm

Big Learning with Bayesian Methods

Divide-and-Conquer Strategy for Large-Scale Dynamic Bayesian Network Structure Learning

Learning Bayesian Networks From Data: An Efficient Approach Based On Extended Evolutionary Programming

Research on an advanced intelligence implementation system for engineering process in industrial field under big data

ExDBN: Exact learning of Dynamic Bayesian Networks

PEnBayes: A Multi-Layered Ensemble Approach for Learning Bayesian Network Structure from Big Data

Towards an effective practice of learning from data and knowledge

Learning Bayesian Networks Structures From Incomplete Data Based On Extending Evolutionary Programming

Incorporating expert knowledge when learning Bayesian network structure: A medical case study