Abstract:Markov random field (MRF) and belief propagation have given birth to stereo vision algorithms with top performance. This article explores their biological plausibility. First, an MRF model guided by physiological and psychophysical facts was designed. Typically an MRF-based stereo vision algorithm employs a likelihood function that reflects the local similarity of two regions and a potential function that models the continuity constraint. In our model, the likelihood function is constructed on the basis of the disparity energy model because complex cells are considered as front-end disparity encoders in the visual pathway. Our likelihood function is also relevant to several psychological findings. The potential function in our model is constrained by the psychological finding that the strength of the cooperative interaction minimizing relative disparity decreases as the separation between stimuli increases. Our model is tested on three kinds of stereo images. In simulations on images with repetitive patterns, we demonstrate that our model could account for the human depth percepts that were previously explained by the second-order mechanism. In simulations on random dot stereograms and natural scene images, we demonstrate that false matches introduced by the disparity energy model can be reliably removed using our model. A comparison with the coarse-to-fine model shows that our model is able to compute the absolute disparity of small objects with larger relative disparity. We also relate our model to several physiological findings. The hypothesized neurons of the model are selective for absolute disparity and have facilitative extra receptive field. There are plenty of such neurons in the visual cortex. In conclusion, we think that stereopsis can be implemented by neural networks resembling MRF.

Utilizing the ability of human visual phase discrimination for stereo vision

Human-Computer Interaction System Based on Binocular Stereo Vision

High-speed 360 3D shape measurement based on visual stereo phase unwrapping method

High-speed 360° 3D shape measurement based on virtual stereo phase unwrapping method

Phase-based learning for micro-baseline depth estimation

Enhanced geometric constraint-based phase unwrapping algorithm in binocular stereo vision fringe projection system

On Adjustment of Stereo Parameters in Multiview Synthesis for Planar 3d Displays

Stereo image quality assessment based on visual attention

Visually Imbalanced Stereo Matching

Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation

StereoPasting: interactive composition in stereoscopic images.

Stereo Vision Conversion from Planar Videos Based on Temporal Multiplane Images

Graph-based Stereo Matching by Incorporating Monocular Cues

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

Extracting Disparity Map from Bifocal Monocular Stereo Vision in a Novel Way

Modeling stereopsis via Markov random field

Multilevel Feature Detection Algorithm Based on Bifocal Monocular Stereo Vision

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

Stereo Vision Using Two PTZ Cameras

Phase Unwrapping by Imitating Vision Process

Subjective quality assessment of stereo image compression based on stereoscopic fusion in binocular vision