Abstract:Bayesian inference for undirected graphical models is mostly restricted to the class of decomposable graphs, as they enjoy a rich set of properties making them amenable to high-dimensional problems. While parameter inference is straightforward in this setup, inferring the underlying graph is a challenge driven by the computational difficulty in exploring the space of decomposable graphs. This work makes two contributions to address this problem. First, we provide sufficient and necessary conditions for when multi-edge perturbations maintain decomposability of the graph. Using these, we characterize a simple class of partitions that efficiently classify all edge perturbations by whether they maintain decomposability. Second, we propose a novel parallel nonreversible Markov chain Monte Carlo sampler for distributions over junction tree representations of the graph. At every step, the parallel sampler executes simultaneously all edge perturbations within a partition. Through simulations, we demonstrate the efficiency of our new edge perturbation conditions and class of partitions. We find that our parallel sampler yields improved mixing properties in comparison to the single-move variate, and outperforms current state-of-the-art methods in terms of accuracy and computational efficiency. The implementation of our work is available in the Python package parallelDG. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

MCMC using Markov bases for computing p -values in decomposable log-linear models

Markov Bases: A 25 Year Update

MCMC conditional maximum likelihood for the two-way fixed-effects logit

Bayesian estimation for longitudinal data in a joint model with HPCs

Generating contingency tables with fixed marginal probabilities and dependence structures described by loglinear models

Covariance estimation using Markov chain Monte Carlo

Parallel Markov Chain Monte Carlo for Non-Gaussian Posterior Distributions

Efficient History Matching Using the Markov-Chain Monte Carlo Method by Means of the Transformed Adaptive Stochastic Collocation Method

GenMarkov: Modeling Generalized Multivariate Markov Chains in R

A Point on Discrete versus Continuous State-Space Markov Chains

Bayesian Inference on Principal Component Analysis Using Reversible Jump Markov Chain Monte Carlo.

Quantifying Uncertainty in Transdimensional Markov Chain Monte Carlo Using Discrete Markov Models

Understanding Linchpin Variables in Markov Chain Monte Carlo

Unbiased Markov chain Monte Carlo methods with couplings

Max Markov Chain

Scalable Estimation of Multinomial Response Models with Random Consideration Sets

Markov Observation Models

Markov chain Monte Carlo methods for the regular two-level fractional factorial designs and cut ideals

Beliefs in Markov Trees - From Local Computations to Local Valuation

Parallel Sampling of Decomposable Graphs Using Markov Chains on Junction Trees

Markov counting models for correlated binary responses