Abstract:Markov chain Monte Carlo (MCMC) methods have been used in many fields (physics, chemistry, biology, and computer science) for simulation, inference, and optimization. In many applications, Markov chains are simulated for sampling from target probabilities π(X) defined on graphs G. The graph vertices represent elements of the system, the edges represent spatial relationships, while X is a vector of variables on the vertices which often take discrete values called labels or colors. Designing efficient Markov chains is a challenging task when the variables are strongly coupled. Because of this, methods such as the single-site Gibbs sampler often experience suboptimal performance. A well-celebrated algorithm, the Swendsen–Wang (SW) method, can address the coupling problem. It clusters the vertices as connected components after turning off some edges probabilistically, and changes the color of one cluster as a whole. It is known to mix rapidly under certain conditions. Unfortunately, the SW method has limited applicability and slows down in the presence of “external fields;” for example, likelihoods in Bayesian inference. In this article, we present a general cluster algorithm that extends the SW algorithm to general Bayesian inference on graphs. We focus on image analysis problems where the graph sizes are in the order of 103–106 with small connectivity. The edge probabilities for clustering are computed using discriminative probabilities from data. We design versions of the algorithm to work on multi grid and multilevel graphs, and present applications to two typical problems in image analysis, namely image segmentation and motion analysis. In our experiments, the algorithm is at least two orders of magnitude faster (in CPU time) than the single-site Gibbs sampler.

Kernel GMM and Its Application to Image Binarization

Kernel Trick Embedded Gaussian Mixture Model

Color Image Segmentation: Kernel Do the Feature Space.

Kernel-like Impurity Detection According to Colour Band Spectral Image Using GA/SVM

Distance-Based Classifier Via the Kernel Trick.

Kernel Principle Component Analysis in Pixels Clustering

Three-dimensional Epanechnikov mixture regression in image coding

Learning Gaussian mixture model with a maximization-maximization algorithm for image classification

A Split and Merge EM Algorithm for Color Image Segmentation

KPCA for semantic object extraction in images

Bayesian Generalized Kernel Mixed Models

Kernel-Based Mixture Mapping for Image and Text Association

Robust Image Matching Via Feature Guided Gaussian Mixture Model

Texture Segmentation Using Kernel-based Techniques

BM-GMM: Belief Function-Based Gaussian Markov Model for Image Segmentation

GMM Based Adaptive Thresholding for Uneven Lighting Image Binarization

Performance of Gaussian Mixture Model Classifiers on Embedded Feature Spaces

Image segmentation using spectral clustering of Gaussian mixture models

A New Method for Determining the Parameter of Gaussian Kernel

Generalizing Swendsen–Wang for Image Analysis

Image Classification with Kernelized Spatial-Context.