Abstract:We propose using recognition networks for approximate inference inBayesian networks (BNs). A recognition network is a multilayerperception (MLP) trained to predict posterior marginals given observedevidence in a particular BN. The input to the MLP is a vector of thestates of the evidential nodes. The activity of an output unit isinterpreted as a prediction of the posterior marginal of thecorresponding variable. The MLP is trained using samples generated fromthe corresponding <a class="link-external link-http" href="http://BN.We" rel="external noopener nofollow">this http URL</a> evaluate a recognition network that was trained to do inference ina large Bayesian network, similar in structure and complexity to theQuick Medical Reference, Decision Theoretic (QMR-DT). Our networkis a binary, two-layer, noisy-OR network containing over 4000 potentially observable nodes and over 600 unobservable, hidden nodes. Inreal medical diagnosis, most observables are unavailable, and there isa complex and unknown bias that selects which ones are provided. Weincorporate a very basic type of selection bias in our network: a knownpreference that available observables are positive rather than <a class="link-external link-http" href="http://negative.Even" rel="external noopener nofollow">this http URL</a> this simple bias has a significant effect on the posterior. We compare the performance of our recognition network tostate-of-the-art approximate inference algorithms on a large set oftest cases. In order to evaluate the effect of our simplistic modelof the selection bias, we evaluate algorithms using a variety ofincorrectly modeled observation biases. Recognition networks performwell using both correct and incorrect observation biases.

On Bayesian Network Approximation by Edge Deletion

Approximation Algorithm of Variable Elimination of Bayesian Network

Efficient Approximations for the Marginal Likelihood of Incomplete Data Given a Bayesian Network

Evidence Networks: simple losses for fast, amortized, neural Bayesian model comparison

Understanding Approximation for Bayesian Inference in Neural Networks

Combinatorial Approximations for Cluster Deletion: Simpler, Faster, and Better

Visualizing the Consequences of Evidence in Bayesian Networks

Importance Sampling in Bayesian Networks: An Influence-Based Approximation Strategy for Importance Functions

Bounded Degree Approximations of Stochastic Networks

Decomposition and Approximation of Loopy Bayesian Networks.

Using a Bayesian approach to reconstruct graph statistics after edge sampling

Balance Maximization in Signed Networks via Edge Deletions

Approximate Data Deletion from Machine Learning Models

Bayesian networks and probabilistic reasoning about scientific evidence when there is a lack of data

A Discrete Perspective Towards the Construction of Sparse Probabilistic Boolean Networks

Recognition Networks for Approximate Inference in BN20 Networks

Model Comparison in Approximate Bayesian Computation

Promotion/Inhibition Effects in Networks: A Model with Negative Probabilities

On Robust Trimming of Bayesian Network Classifiers

Efficient Stein Variational Inference for Reliable Distribution-lossless Network Pruning

Efficient Model Compression for Bayesian Neural Networks