Abstract:Visual segmentation is a key perceptual function that partitions visual space and allows for detection, recognition and discrimination of objects in complex environments. The processes underlying human segmentation of natural images are still poorly understood. In part, this is because we lack segmentation models consistent with experimental and theoretical knowledge in visual neuroscience. Biological sensory systems have been shown to approximate probabilistic inference to interpret their inputs. This requires a generative model that captures both the statistics of the sensory inputs and expectations about the causes of those inputs. Following this hypothesis, we propose a probabilistic generative model of visual segmentation that combines knowledge about 1) the sensitivity of neurons in the visual cortex to statistical regularities in natural images; and 2) the preference of humans to form contiguous partitions of visual space. We develop an efficient algorithm for training and inference based on expectation-maximization and validate it on synthetic data. Importantly, with the appropriate choice of the prior, we derive an intuitive closed--form update rule for assigning pixels to segments: at each iteration, the pixel assignment probabilities to segments is the sum of the evidence (i.e. local pixel statistics) and prior (i.e. the assignments of neighboring pixels) weighted by their relative uncertainty. The model performs competitively on natural images from the Berkeley Segmentation Dataset (BSD), and we illustrate how the likelihood and prior components improve segmentation relative to traditional mixture models. Furthermore, our model explains some variability across human subjects as reflecting local uncertainty about the number of segments. Our model thus provides a viable approach to probe human visual segmentation.

Stochastic Model for Medical Image Segmentation

Gaussian Mixture Model Based Probabilistic Modeling of Images for Medical Image Segmentation

An Improved Random Walker with Bayes Model for Volumetric Medical Image Segmentation.

Variational Model for Image Segmentation.

Probabilistic Model of Visual Segmentation

Image segmentation by MAP-ML estimations.

A Novel Model-Based Approach for Medical Image Segmentation Using Spatially Constrained Inverted Dirichlet Mixture Models

A Markov Random Field Model for Image Segmentation Based on Gestalt Laws.

Superpixel Segmentation Using Gaussian Mixture Model

From Deterministic to Probabilistic: A Novel Perspective on Domain Generalization for Medical Image Segmentation

A Chan-Vese Model Based on the Markov Chain for Unsupervised Medical Image Segmentation

A Methodology for Modeling the Distributions of Medical Images and Their Stochastic Properties

A Split and Merge EM Algorithm for Color Image Segmentation

An Image Segmentation Algorithm Based on Improved Multiscale Random Field Model in Wavelet Domain

Image Segmentation Using Bayesian Inference for Convex Variant Mumford–Shah Variational Model

BayeSeg: Bayesian Modeling for Medical Image Segmentation with Interpretable Generalizability

Robust model for segmenting images with/without intensity inhomogeneities

Probabilistic Spatial-Temporal Segmentation of Multiple Sclerosis Lesions

Interactive segmentation method with graph cut and SVMs

An Improved Medical Image Segmentation Model with Local Region Features

Design and Implementation of Obstetric Central Monitoring System Based on Medical Image Segmentation Algorithm