Abstract:Visual segmentation is a key perceptual function that partitions visual space and allows for detection, recognition and discrimination of objects in complex environments. The processes underlying human segmentation of natural images are still poorly understood. In part, this is because we lack segmentation models consistent with experimental and theoretical knowledge in visual neuroscience. Biological sensory systems have been shown to approximate probabilistic inference to interpret their inputs. This requires a generative model that captures both the statistics of the sensory inputs and expectations about the causes of those inputs. Following this hypothesis, we propose a probabilistic generative model of visual segmentation that combines knowledge about 1) the sensitivity of neurons in the visual cortex to statistical regularities in natural images; and 2) the preference of humans to form contiguous partitions of visual space. We develop an efficient algorithm for training and inference based on expectation-maximization and validate it on synthetic data. Importantly, with the appropriate choice of the prior, we derive an intuitive closed--form update rule for assigning pixels to segments: at each iteration, the pixel assignment probabilities to segments is the sum of the evidence (i.e. local pixel statistics) and prior (i.e. the assignments of neighboring pixels) weighted by their relative uncertainty. The model performs competitively on natural images from the Berkeley Segmentation Dataset (BSD), and we illustrate how the likelihood and prior components improve segmentation relative to traditional mixture models. Furthermore, our model explains some variability across human subjects as reflecting local uncertainty about the number of segments. Our model thus provides a viable approach to probe human visual segmentation.

Vision In V1 For Pre-Attentive Segmentation

Vision in V 1 for Pre-attentive Segmentation

Pre-Attentive Segmentation in the Primary Visual Cortex

Pop-Out Theory: Segmentation Without Classification By The Primary Visual Cortex

Visual Segmentation Without Classification: a Proposed Function for Primary Visual Cortex

Visual Segmentation by Contextual Influences Via Intra-Cortical Interactions in the Primary Visual Cortex

Perceptual Integration Rapidly Activates Dorsal Visual Pathway to Guide Local Processing in Early Visual Areas

Visual Segmentation Without Classification in a Model of the Primary Visual Cortex

Pre–attentive Segmentation and Correspondence in Stereo

Pre-attentive segmentation and correspondence in stereo.

The V1 hypothesis—creating a bottom-up saliency map for preattentive selection and segmentation

Contextual Influences In V1 As A Basis For Pop Out And Asymmetry In Visual Search

FPGA-Accelerated Pre-Attentive Segmentation in Primary Visual Cortex

Foreground-Background Segmentation Revealed during Natural Image Viewing

Probabilistic Model of Visual Segmentation

A V1 Model of Pop out and Asymmetry in Visual Search

A source for awareness-dependent figure–ground segregation in human prefrontal cortex

Primary Cortical Dynamics for Visual Grouping

Image Understanding, Attention and Human Early Visual Cortex

Edge detection based on characteristic of V1 cells

Perceptual Learning of Pop-out and the Primary Visual Cortex