Abstract:A neural network theory of three-dimensional (3-D) vision, called FACADE theory, is described. The theory proposes a solution of the classical figure-ground problem for biological vision. It does so by suggesting how boundary representations and surface representations are formed within a boundary contour system (BCS) and a feature contour system (FCS). The BCS and FCS interact reciprocally to form 3-D boundary and surface representations that are mutually consistent. Their interactions generate 3-D percepts wherein occluding and occluded object parts are separated, completed, and grouped. The theory clarifies how preattentive processes of 3-D perception and figure-ground separation interact reciprocally with attentive processes of spatial localization, object recognition, and visual search. A new theory of stereopsis is proposed that predicts how cells sensitive to multiple spatial frequencies, disparities, and orientations are combined by context-sensitive filtering, competition, and cooperation to form coherent BCS boundary segmentations. Several factors contribute to figure-ground pop-out, including: boundary contrast between spatially contiguous boundaries, whether due to scenic differences in luminance, color, spatial frequency, or disparity; partially ordered interactions from larger spatial scales and disparities to smaller scales and disparities; and surface filling-in restricted to regions surrounded by a connected boundary. Phenomena such as 3-D pop-out from a 2-D picture, Da Vinci stereopsis, 3-D neon color spreading, completion of partially occluded objects, and figure-ground reversals are analyzed. The BCS and FCS subsystems model aspects of how the two parvocellular cortical processing streams that join the lateral geniculate nucleus to prestriate cortical area V4 interact to generate a multiplexed representation of Form-And-Color-And-DEpth, or FACADE, within area V4. Area V4 is suggested to support figure-ground separation and to interact with cortical mechanisms of spatial attention, attentive object learning, and visual search. Adaptive resonance theory (ART) mechanisms model aspects of how prestriate visual cortex interacts reciprocally with a visual object recognition system in inferotemporal (IT) cortex for purposes of attentive object learning and categorization. Object attention mechanisms of the What cortical processing stream through IT cortex are distinguished from spatial attention mechanisms of the Where cortical processing stream through parietal cortex. Parvocellular BCS and FCS signals interact with the model What stream. Parvocellular FCS and magnocellular motion BCS signals interact with the model Where stream.(ABSTRACT TRUNCATED AT 400 WORDS)

Multivariate Analysis of BOLD Activation Patterns Recovers Graded Depth Representations in Human Visual and Parietal Cortex

Multivoxel Pattern Selectivity for Perceptually Relevant Binocular Disparities in the Human Brain

Functional specialization in human dorsal pathway for stereoscopic depth processing

Responses to interocular disparity correlation in the human cerebral cortex

Decoding 3D Spatial Location Across Saccades in Human Visual Cortex

Dissociation of retinal and headcentric disparity signals in dorsal human cortex

Correlation and Matching Representations of Binocular Disparity across the Human Visual Cortex

Spatial scale and distribution of neurovascular signals underlying decoding of orientation and eye of origin from fMRI data

Visualizing fMRI BOLD responses to diverse naturalistic scenes using retinotopic projection

More Than Meets the Eye: Self-Supervised Depth Reconstruction From Brain Activity

A retinotopic reference frame for space throughout human visual cortex

3D Contrast Image Reconstruction From Human Brain Activity

Stereoscopic processing of crossed and uncrossed disparities in the human visual cortex

Immersive scene representation in human visual cortex with ultra-wide angle neuroimaging

Modeling pre-attentive stereo grouping by intracortical interactions in early visual cortex

A 2D Gabor-wavelet baseline model out-performs a 3D surface model in scene-responsive cortex

Relationship between BOLD amplitude and pattern classification of orientation-selective activity in the human visual cortex

Naturalistic Movies and Encoding Analysis Redefine Areal Borders in Primate Visual Cortex

3-D vision and figure-ground separation by visual cortex

Reversed Depth in Anticorrelated Random-Dot Stereograms and the Central-Peripheral Difference in Visual Inference.

Mapping object space dimensions: new insights from temporal dynamics