Abstract:Visual segmentation is a key perceptual function that partitions visual space and allows for detection, recognition and discrimination of objects in complex environments. The processes underlying human segmentation of natural images are still poorly understood. In part, this is because we lack segmentation models consistent with experimental and theoretical knowledge in visual neuroscience. Biological sensory systems have been shown to approximate probabilistic inference to interpret their inputs. This requires a generative model that captures both the statistics of the sensory inputs and expectations about the causes of those inputs. Following this hypothesis, we propose a probabilistic generative model of visual segmentation that combines knowledge about 1) the sensitivity of neurons in the visual cortex to statistical regularities in natural images; and 2) the preference of humans to form contiguous partitions of visual space. We develop an efficient algorithm for training and inference based on expectation-maximization and validate it on synthetic data. Importantly, with the appropriate choice of the prior, we derive an intuitive closed--form update rule for assigning pixels to segments: at each iteration, the pixel assignment probabilities to segments is the sum of the evidence (i.e. local pixel statistics) and prior (i.e. the assignments of neighboring pixels) weighted by their relative uncertainty. The model performs competitively on natural images from the Berkeley Segmentation Dataset (BSD), and we illustrate how the likelihood and prior components improve segmentation relative to traditional mixture models. Furthermore, our model explains some variability across human subjects as reflecting local uncertainty about the number of segments. Our model thus provides a viable approach to probe human visual segmentation.

A Markov Random Field Model for Image Segmentation Based on Gestalt Laws.

Segmentation Algorithm of Moving Object Based on Mean Field Theory and MRF-MAP

Vibration-resisted video segmentation algorithm based on hierarchical Markov random field model

Interesting moving object segmentation based on selective visual attention and Markov random field

Interactive Color Image Segmentation by Region Growing Combined with Image Enhancement Based on Bezier Model

Embedding Gestalt Laws in Markov Random Fields

Image segmentation by MAP-ML estimations.

Embedding Gestalt Laws in Markov Random Fields - a theory for shape modeling and perceptual organization

A convex neighbor-constrained active contour model for image segmentation

A New Localized Superpixel Markov Random Field for Image Segmentation

MCMC algorithm based on Markov random field in image segmentation

A Markov Random Field Model-Based Approach to Natural Image Matting

Efficient video object segmentation based on Gaussian mixture model and Markov random field

A Three-Stage Variational Image Segmentation Framework Incorporating Intensity Inhomogeneity Information

From Local Features To Global Perception - A Perspective Of Gestalt Psychology From Markov Random Field Theory

A Robust Patch-Statistical Active Contour Model for Image Segmentation

Contour Based Automatic Scene Segmentation in Image Sequences

Probabilistic Model of Visual Segmentation

An Image Segmentation Algorithm Based on Improved Multiscale Random Field Model in Wavelet Domain

A novel active contour model for image segmentation using local and global region-based information

Variational Model for Image Segmentation.