Abstract:Discovering the Bayesian network (BN) structure from big datasets containing rich causal relationships is becoming increasingly valuable for modeling and reasoning under uncertainties in many areas with big data gathered from sensors due to high volume and fast veracity. Most of the current BN structure learning algorithms have shortcomings facing big data. First, learning a BN structure from the entire big dataset is an expensive task which often ends in failure due to memory constraints. Second, it is quite difficult to select a learner from numerous BN structure learning algorithms to consistently achieve good learning accuracy. Lastly, there is a lack of an intelligent method that merges separately learned BN structures into a well structured BN network. To address these shortcomings, we introduce a novel parallel learning approach called PEnBayes (Parallel Ensemble-based Bayesian network learning). PEnBayes starts with an adaptive data preprocessing phase that calculates the Appropriate Learning Size and intelligently divides a big dataset for fast distributed local structure learning. Then, PEnBayes learns a collection of local BN Structures in parallel using a two-layered weighted adjacent matrix-based structure ensemble method. Lastly, PEnBayes merges the local BN Structures into a global network structure using the structure ensemble method at the global layer. For the experiment, we generate big data sets by simulating sensor data from patient monitoring, transportation, and disease diagnosis domains. The Experimental results show that PEnBayes achieves a significantly improved execution performance with more consistent and stable results compared with three baseline learning algorithms.

Matrix Factorization Based Bayesian Network Embedding for Efficient Probabilistic Inferences.

Data-Intensive Inferences Of Large-Scale Bayesian Networks

Faster-BNI: Fast Parallel Exact Inference on Bayesian Networks

Bayesian Network Parameter Learning Using Constraint-Based Data Extension Method

Improved High Dimensional Discrete Bayesian Network Inference using Triplet Region Construction

A Factor Tree Inference Algorithm for Bayesian Networks and Its Application

Learning Bayesian Networks by Constrained Bayesian Estimation

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Fast Parallel Exact Inference on Bayesian Networks: Poster

A Parallel and Incremental Approach for Data-Intensive Learning of Bayesian Networks

Semantically-linked Bayesian Network: a Framework for Probabilistic Inference over Multiple Bayesian Networks

Efficient Bayes Inference in Neural Networks through Adaptive Importance Sampling

Stacking Factorizing Partitioned Expressions in Hybrid Bayesian Network Models

A modeling framework for detecting and leveraging node-level information in Bayesian network inference

Learning a Bayesian network with multiple latent variables for implicit relation representation

PEnBayes: A Multi-Layered Ensemble Approach for Learning Bayesian Network Structure from Big Data

A Full Bayesian Approach to Sparse Network Inference Using Heterogeneous Datasets

A Bayesian Graph Embedding Model for Link-Based Classification Problems

Advances to Bayesian network inference for generating causal networks from observational biological data

Unscented Message Passing for Arbitrary Continuous Variables in Bayesian Networks.

A Learning Algorithm for Bayesian Networks and Its Efficient Implementation on GPUs