Abstract:We propose using recognition networks for approximate inference inBayesian networks (BNs). A recognition network is a multilayerperception (MLP) trained to predict posterior marginals given observedevidence in a particular BN. The input to the MLP is a vector of thestates of the evidential nodes. The activity of an output unit isinterpreted as a prediction of the posterior marginal of thecorresponding variable. The MLP is trained using samples generated fromthe corresponding <a class="link-external link-http" href="http://BN.We" rel="external noopener nofollow">this http URL</a> evaluate a recognition network that was trained to do inference ina large Bayesian network, similar in structure and complexity to theQuick Medical Reference, Decision Theoretic (QMR-DT). Our networkis a binary, two-layer, noisy-OR network containing over 4000 potentially observable nodes and over 600 unobservable, hidden nodes. Inreal medical diagnosis, most observables are unavailable, and there isa complex and unknown bias that selects which ones are provided. Weincorporate a very basic type of selection bias in our network: a knownpreference that available observables are positive rather than <a class="link-external link-http" href="http://negative.Even" rel="external noopener nofollow">this http URL</a> this simple bias has a significant effect on the posterior. We compare the performance of our recognition network tostate-of-the-art approximate inference algorithms on a large set oftest cases. In order to evaluate the effect of our simplistic modelof the selection bias, we evaluate algorithms using a variety ofincorrectly modeled observation biases. Recognition networks performwell using both correct and incorrect observation biases.

A Channel-based Exact Inference Algorithm for Bayesian Networks

A Unified Bayesian Inference Framework for Generalized Linear Models

A Channel-Based Perspective on Conjugate Priors

1-Bit Compressive Diffusion in Networks Based on Bayesian Inference.

Quantum inference on Bayesian networks

Inference in Hybrid Bayesian Networks Using Mixtures of Gaussians

Bayesian Inference by Symbolic Model Checking

Inference algorithms and learning theory for Bayesian sparse factor analysis

Fast Parallel Exact Inference on Bayesian Networks: Poster

Expectation Propagation for approximate Bayesian inference

The Compositional Structure of Bayesian Inference

Recognition Networks for Approximate Inference in BN20 Networks

Inference And Modeling Of Multiply Sectioned Bayesian Networks

Exact Bayesian Inference on Discrete Models via Probability Generating Functions: A Probabilistic Programming Approach

Picturing classical and quantum Bayesian inference

Copy-composition for probabilistic graphical models

Higher-Order Bayesian Networks, Exactly (Extended version)

The Quantified Boolean Bayesian Network: Theory and Experiments with a Logical Graphical Model

Efficient Approximations for the Marginal Likelihood of Incomplete Data Given a Bayesian Network

A Unified Theory of Exact Inference and Learning in Exponential Family Latent Variable Models

Approximate inference of marginals using the IBIA framework