Abstract:Markov chain Monte Carlo (MCMC) methods have been used in many fields (physics, chemistry, biology, and computer science) for simulation, inference, and optimization. In many applications, Markov chains are simulated for sampling from target probabilities π(X) defined on graphs G. The graph vertices represent elements of the system, the edges represent spatial relationships, while X is a vector of variables on the vertices which often take discrete values called labels or colors. Designing efficient Markov chains is a challenging task when the variables are strongly coupled. Because of this, methods such as the single-site Gibbs sampler often experience suboptimal performance. A well-celebrated algorithm, the Swendsen–Wang (SW) method, can address the coupling problem. It clusters the vertices as connected components after turning off some edges probabilistically, and changes the color of one cluster as a whole. It is known to mix rapidly under certain conditions. Unfortunately, the SW method has limited applicability and slows down in the presence of “external fields;” for example, likelihoods in Bayesian inference. In this article, we present a general cluster algorithm that extends the SW algorithm to general Bayesian inference on graphs. We focus on image analysis problems where the graph sizes are in the order of 103–106 with small connectivity. The edge probabilities for clustering are computed using discriminative probabilities from data. We design versions of the algorithm to work on multi grid and multilevel graphs, and present applications to two typical problems in image analysis, namely image segmentation and motion analysis. In our experiments, the algorithm is at least two orders of magnitude faster (in CPU time) than the single-site Gibbs sampler.

A Bayesian Approach to Clustering Matting Components in Spectral Matting

Weakly Supervised Image Matting Via Patch Clustering

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

A Markov Random Field Model-Based Approach to Natural Image Matting

Bayesian Clustering with Variable and Transformation Selections

Simultaneous Bayesian Clustering and Model Selection with Mixture of Robust Factor Analyzers

A Survey on Natural Image Matting with Closed-Form Solutions.

Consistency of Graphical Model-based Clustering: Robust Clustering using Bayesian Spanning Forest

Easy Matting - A Stroke Based Approach for Continuous Image Matting

A Spectral Clustering Image Segmentation Algorithm Based on Nyström Approximation

Bayesian Adversarial Spectral Clustering With Unknown Cluster Number

MRF matting on complex images

Bayesian Nonparametric Graph Clustering

Area-correlated Spectral Unmixing Based on Bayesian Nonnegative Matrix Factorization

A Bayesian approach for clustering skewed data using mixtures of multivariate normal-inverse Gaussian distributions

Model-based clustering based on sparse finite Gaussian mixtures

Analysis of Professional Basketball Field Goal Attempts via a Bayesian Matrix Clustering Approach

Interactive space-time video matting approach

Generalizing Swendsen–Wang for Image Analysis

Bayesian Inference for Layer Representation with Mixed Markov Random Field

A Bayesian Mixture Model of Temporal Point Processes with Determinantal Point Process Prior