The perception of depth in simple figures

Graeme Mitchison,Gerald Westheimer

DOI: https://doi.org/10.1016/0042-6989(84)90084-1

IF: 1.8

1984-12-31

Vision Research

Abstract:

What problem does this paper attempt to address?

Assessment of Perceptual Depth Intensity on Source Stereoscopic Images

Jiaqi Zhang,Minxia Yang,Lu Yu,Rende Shui

DOI: https://doi.org/10.1109/ISCAS45731.2020.9180756

2020-01-01

Abstract:Accurate and efficient objective assessment methods for multidimensional quality of experience (QoE) of stereoscopic 3D content are in urgent demand. Especially, depth perception quantization for source 3D content is necessary to optimize the comprehensive QoE. A few studies evaluate the depth quality degradation due to compression or transmission, while the objective assessment of perceptual depth intensity has not been deeply investigated. In this paper, we propose a depth intensity metric (DIM) to simulate subjective evaluation on uncompressed source 3D images. Considering the multi-cue aggregation mechanism in depth perception as well as visual characteristic of binocular fusion, perceptual features are extracted from binocular and monocular cues to generate the depth intensity perception score. The effectiveness of DIM is verified by conducting subjective experiment on publicly available stereoscopic image databases. Experimental results demonstrate that DIM can achieve higher accuracy compared to the state-of-the-art depth intensity metric.
Distance Deception by Fragmented Objects: How Figures May Alter the Perceived Depth of the Background

Sergio Roncato

DOI: https://doi.org/10.1177/03010066221078676

IF: 1.695

Perception

Abstract:Illusory displacements in depth may be perceived in simple geometric configurations devoid of cues for spatial computation but also in real-world images where there is no shortage of information of this kind. Two of these different contexts drew the attention of vision scientists as sources of depth illusions: the Kanizsa square and the images of statues that Catalano's created with a part missing. Similar depth alterations occur in both cases: the portions of the background surrounded by "inducers" (pacmen or body parts) are perceived as coming to the foreground. These illusory effects appear more vivid and diverse in the real-world context leading to hypothesize an involvement of the figural complexity in the misperception. A check was carried out by testing the effects of the background articulation on the depth perception of the illusory Kanizsa square. It was confirmed that both background and inducers articulation enhance the phenomenon. A large set of Catalano's images was analyzed, looking for basic distorting sources along the torn contours. Several basic factors were found, but not enough to account for the complexity of this variegated, often paradoxical phenomenon.
Depth Compression Based on Mis-Scaling of Binocular Disparity May Contribute to Angular Expansion in Perceived Optical Slant.

Zhi Li,Frank H. Durgin

DOI: https://doi.org/10.1167/13.12.3

2013-01-01

Journal of Vision

Abstract:Three studies, involving a total of 145 observers examined quantitative theories of the overestimation of perceived optical slant. The first two studies investigated the depth/width anisotropies on positive and negative slant in both pitch and yaw at 2 and 8 m using calibrated immersive virtual environments. Observers made judgments of the relative lengths of extents that were frontal with those that were in depth. The physical aspect ratio that was perceived as 1:1 was determined for each slant. The observed anisotropies can be modeled by assuming overestimation in perceived slant. Three one-parameter slant perception models (angular expansion, affine depth compression caused by mis-scaling of binocular disparity, and intrinsic bias) were compared. The angular expansion and the affine depth compression models provided significantly better fits to the aspect ratio data than the intrinsic bias model did. The affine model required depth compression at the 2 m distance; however, that was much more than the depth compression measured directly in the third study using the same apparatus. The present results suggest that depth compression based on mis-scaling of binocular disparity may contribute to slant overestimation, especially as viewing distance increases, but also suggest that a functional rather than mechanistic account may be more appropriate for explaining biases in perceived slant in near space.
On the anisotropy of perceived ground extents and the interpretation of walked distance as a measure of perception.

Zhi Li,Emily Sun,Cassandra J Strawser,Ariana Spiegel,Brennan Klein,Frank H Durgin

DOI: https://doi.org/10.1037/a0029405

2013-01-01

Abstract:Two experiments are reported concerning the perception of ground extent to discover whether prior reports of anisotropy between frontal extents and extents in depth were consistent across different measures (visual matching and pantomime walking) and test environments (outdoor environments and virtual environments). In Experiment 1 it was found that depth extents of up to 7 m are indeed perceptually compressed relative to frontal extents in an outdoor environment, and that perceptual matching provided more precise estimates than did pantomime walking. In Experiment 2, similar anisotropies were found using similar tasks in a similar (but virtual) environment. In both experiments pantomime walking measures seemed to additionally compress the range of responses. Experiment 3 supported the hypothesis that range compression in walking measures of perceived distance might be due to proactive interference (memory contamination). It is concluded that walking measures are calibrated for perceived egocentric distance, but that pantomime walking measures may suffer range compression. Depth extents along the ground are perceptually compressed relative to frontal ground extents in a manner consistent with the angular scale expansion hypothesis.
Correlated Effects of Relative Size and Depth in the Perceptual Organization of Multiple Figure-Ground Configurations

Birgitta Dresp-Langley,Adam Reeves

DOI: https://doi.org/10.48550/arXiv.1912.06610

2019-12-14

Abstract:The neural networks of the human visual brain derive representations of three-dimensional structure from specific two-dimensional image cues. Neural models backed by psychophysical data predict how local differences in either luminance contrast or physical size of local boundaries in 2D images may determine the perception of 3D properties. Predictions relative to the role of color in this process do not follow from any of the current models. To further clarify the potential contribution of color to perceptual organization, image configurations with multiple surface representations where the relative physical size of local boundaries between contrast regions was held constant were submitted to perceptual judgments of relative size and relative depth. The only potential cues available in the images were generated by the specific local combinations of color and luminance contrast. It is shown that response probabilities for subjective depth and subjective size are systematically and consistently determined by local surface colors and their immediate backgrounds. There is a statistically significant correlation between subjective depth and subjective size, and a color specific effect on both dependent variables. This effect depends on the polarity of the immediate surround of the reference surface rather than on local center-surround contrast intensity. It is suggested that the underlying neural mechanisms selectively exploit specific color and background cues to enable intrinsically coherent perceptual organization of ambiguous image input.

Neurons and Cognition
Towards Quantifying Depth and Size Perception in Virtual Environments

Jannick P. Rolland,William Gibson,Dan Ariely

DOI: https://doi.org/10.1162/pres.1995.4.1.24

1995-01-01

Presence: Teleoperators and Virtual Environments

Abstract:With the rapid advance of real-time computer graphics, head-mounted displays (HMDs) have become popular tools for 3D visualization. One of the most promising and challenging future uses of HMDs, however, is in applications where virtual environments enhance rather than replace real environments. In such applications, a virtual image is superimposed on a real image. The unique problem raised by this superimposition is the difficulty that the human visual system may have in integrating information from these two environments. As a starting point to studying the problem of information integration in see-through environments, we investigate the quantification of depth and size perception of virtual objects relative to real objects in combined real and virtual environments. This starting point leads directly to the important issue of system calibration, which must be completed before perceived depth and sizes are measured. Finally, preliminary experimental results on the perceived depth of spatially nonoverlapping real and virtual objects are presented.
3D computational modeling and perceptual analysis of kinetic depth effects

Meng-Yao Cui,Shao-Ping Lu,Miao Wang,Yong-Liang Yang,Yu-Kun Lai,Paul L. Rosin

DOI: https://doi.org/10.1007/s41095-020-0180-x

IF: 4.1268

2020-08-13

Computational Visual Media

Abstract:Abstract Humans have the ability to perceive kinetic depth effects , i.e., to perceived 3D shapes from 2D projections of rotating 3D objects. This process is based on a variety of visual cues such as lighting and shading effects. However, when such cues are weak or missing, perception can become faulty, as demonstrated by the famous silhouette illusion example of the spinning dancer . Inspired by this, we establish objective and subjective evaluation models of rotated 3D objects by taking their projected 2D images as input. We investigate five different cues: ambient luminance, shading, rotation speed, perspective, and color difference between the objects and background. In the objective evaluation model, we first apply 3D reconstruction algorithms to obtain an objective reconstruction quality metric, and then use quadratic stepwise regression analysis to determine weights of depth cues to represent the reconstruction quality. In the subjective evaluation model, we use a comprehensive user study to reveal correlations with reaction time and accuracy, rotation speed, and perspective. The two evaluation models are generally consistent, and potentially of benefit to inter-disciplinary research into visual perception and 3D reconstruction.

computer science, software engineering
Depth perception of stereoscopic transparent stimuli with frame manipulation

Saori Aida,Shunta Fukamachi,Koichi Shimono

DOI: https://doi.org/10.1038/s41598-024-57283-9

IF: 4.6

2024-03-21

Scientific Reports

Abstract:Depth perception is crucial in human vision, allowing us to move and interact with our 3-D surroundings. We used a stereoscopic transparent stimulus comprising parallel overlapping transparent stereoscopic surfaces (POTS) to understand depth perception better. The study focused on exploring the effect of a surrounding frame on the perceived depth of a POTS configuration. The research was based on a proposed idea that explains an "off-frame" effect: a frame at a different depth from a 2-D photograph depicting a 3-D scene increases its apparent depth qualitatively. The idea assumes that processing the disparity between a frame and a photo reduces the reliability of the photograph's flatness cues and increases depth magnitude in depth cue integration. We examined whether the idea can be applied to a 3-D POTS with the flatness cue as the constant accommodation. Through three experiments, the study showed that frames impact the perceived depth magnitude of a POTS configuration. More specifically, the depth magnitude increases as the frame's disparity concerning the monitor plane increases and decreases as the frame's size increases. We discussed the results in the context of depth cue combination.

multidisciplinary sciences
Depth from Defocus in the Wild.

Huixuan Tang,Scott Cohen,Brian Price,Stephen Schiller,Kiriakos N. Kutulakos

DOI: https://doi.org/10.1109/cvpr.2017.507

2017-01-01

Abstract:We consider the problem of two-frame depth from defocus in conditions unsuitable for existing methods yet typical of everyday photography: a non-stationary scene, a handheld cellphone camera, a small aperture, and sparse scene texture. The key idea of our approach is to combine local estimation of depth and flow in very small patches with a global analysis of image content-3D surfaces, deformations, figure-ground relations, textures. To enable local estimation we (1) derive novel defocus-equalization filters that induce brightness constancy across frames and (2) impose a tight upper bound on defocus blur-just three pixels in radius-by appropriately refocusing the camera for the second input frame. For global analysis we use a novel splinebased scene representation that can propagate depth and flow across large irregularly-shaped regions. Our experiments show that this combination preserves sharp boundaries and yields good depth and flow maps in the face of significant noise, non-rigidity, and data sparsity.
Stereoscopic Depth Perception Through Foliage

Robert Kerschner,Rakesh John Amala Arokia Nathan,Rafal Mantiuk,Oliver Bimber

2023-10-25

Abstract:Both humans and computational methods struggle to discriminate the depths of objects hidden beneath foliage. However, such discrimination becomes feasible when we combine computational optical synthetic aperture sensing with the human ability to fuse stereoscopic images. For object identification tasks, as required in search and rescue, wildlife observation, surveillance, and early wildfire detection, depth assists in differentiating true from false findings, such as people, animals, or vehicles vs. sun-heated patches at the ground level or in the tree crowns, or ground fires vs. tree trunks. We used video captured by a drone above dense woodland to test users' ability to discriminate depth. We found that this is impossible when viewing monoscopic video and relying on motion parallax. The same was true with stereoscopic video because of the occlusions caused by foliage. However, when synthetic aperture sensing was used to reduce occlusions and disparity-scaled stereoscopic video was presented, whereas computational (stereoscopic matching) methods were unsuccessful, human observers successfully discriminated depth. This shows the potential of systems which exploit the synergy between computational methods and human vision to perform tasks that neither can perform alone.

Computer Vision and Pattern Recognition,Image and Video Processing
Reversed Depth in Anticorrelated Random-Dot Stereograms and the Central-Peripheral Difference in Visual Inference.

Li Zhaoping,Joelle Ackermann

DOI: https://doi.org/10.1177/0301006618758571

IF: 1.695

2018-01-01

Perception

Abstract:In a random-dot stereogram, the percept of object surfaces in a three-dimensional scene is generated by images presented to left and right eyes that comprise interocularly corresponding random black and white dots. The spatial disparities between the corresponding dots determine the depths of object surfaces. If the dots are anticorrelated, such that a black dot in one monocular image corresponds to a white dot in the other, disparity-tuned neurons in the primary visual cortex (V1) respond as if their preferred disparities become nonpreferred and vice versa, thereby reversing the disparity signs reported to higher visual areas. Typically, when viewing anticorrelated random-dot stereograms presented in the central visual field, humans have great difficulty perceiving the reversed depth or indeed any coherent depth at all. We report that the reversed depth is more easily perceived in the peripheral visual field, supporting a recently proposed central-peripheral dichotomy in the way that feedback from higher to lower visual cortical areas implements visual inference.
Edge highlighting of laser-scanned point clouds improves the accuracy of perceived depth in transparent multi-view 3D visualizations

Daimon Aoi,Kyoko Hasegawa,Liang Li,Yuichi Sakano,Naohisa Sakamoto,Satoshi Tanaka

DOI: https://doi.org/10.1142/s1793962324500211

2024-02-21

International Journal of Modeling Simulation and Scientific Computing

Abstract:International Journal of Modeling, Simulation, and Scientific Computing, Ahead of Print. The rapid development of 3D scanning has allowed us to digitally capture cultural heritage objects as large-scale point clouds, recording their complex internal and external structures. We have developed a 3D multi-view transparent visualization using edge highlighting as visual guide, improving accuracy of perceived depth for reliable visual analyses of the 3D scanned point clouds. When transparently visualizing a 3D object on a 3D multi-view display, the depth information tends to become less distinct. Therefore, we aimed to explore whether emphasizing the statistically extracted 3D edges of the scanned object can enhance the perceived depth of transparently visualized 3D objects. We conducted psychophysical experiments where participants were asked to report their perceived magnitudes of depth for multiple types of 3D structures of cultural heritage presented on a multi-view 3D display. The results indicated that our edge highlighting reduced the underestimation of depth from 46.8% to 34.0% on average. This improvement persisted even when the 3D structures produced an atypical linear perspective, normally caused by reverse depths, where the front and back are reversed. These findings suggest that edge highlighting brings us an effective visual guide to improve the accuracy of perceived depths on a 3D multi-view display.

mathematics, interdisciplinary applications,multidisciplinary sciences
Impact of Background, Foreground, and Manipulated Object Rendering on Egocentric Depth Perception in Virtual and Augmented Indoor Environments

Matthew McQuaigue,Kalpathi Subramanian,Paula Goolkasian,Zachary Wartell

DOI: https://doi.org/10.1109/tvcg.2024.3382616

IF: 5.2

2024-01-01

IEEE Transactions on Visualization and Computer Graphics

Abstract:This research investigated how the similarity of the rendering parameters of background and foreground objects affected egocentric depth perception in indoor virtual and augmented environments. We refer to the similarity of the rendering parameters as visual 'congruence'. Study participants manipulated the depth of a sphere to match the depth of a designated target peg. In the first experiment, the sphere and peg were both virtual, while in the second experiment, the sphere is virtual and the peg is real. In both experiments, depth perception accuracy was found to depend on the levels of realism and congruence between the sphere, pegs, and background. In Experiment 1, realistic backgrounds lead to overestimation of depth, but resulted in underestimation when the background was virtual, and when depth cues were applied to the sphere and target peg. In Experiment 2, background and target pegs were real but matched with the virtual sphere; in comparison to Experiment 1, realistically rendered targets prompted an underestimation and more accuracy with the manipulated object. These findings suggest that congruence can affect distance estimation and the underestimation effect in the AR environment resulted from increased graphical fidelity of the foreground target and background.

computer science, software engineering
Lung Cancer Imaging: Remember the Patient.

J. Ravenel

DOI: https://doi.org/10.1097/RTI.0000000000000224

IF: 5.528

2016-07-01

Journal of Thoracic Imaging

Abstract:
Cortical Dynamics of Figure-Ground Separation in Response to 2D Pictures and 3D Scenes: How V2 Combines Border Ownership, Stereoscopic Cues, and Gestalt Grouping Rules

Stephen Grossberg

DOI: https://doi.org/10.3389/fpsyg.2015.02054

IF: 3.8

2016-01-26

Frontiers in Psychology

Abstract:The FACADE model, and its laminar cortical realization and extension in the 3D LAMINART model, have explained, simulated, and predicted many perceptual and neurobiological data about how the visual cortex carries out 3D vision and figure-ground perception, and how these cortical mechanisms enable 2D pictures to generate 3D percepts of occluding and occluded objects. In particular, these models have proposed how border ownership occurs, but have not yet explicitly explained the correlation between multiple properties of border ownership neurons in cortical area V2 that were reported in a remarkable series of neurophysiological experiments by von der Heydt and his colleagues; namely, border ownership, contrast preference, binocular stereoscopic information, selectivity for side-of-figure, Gestalt rules, and strength of attentional modulation, as well as the time course during which such properties arise. This article shows how, by combining 3D LAMINART properties that were discovered in two parallel streams of research, a unified explanation of these properties emerges. This explanation proposes, moreover, how these properties contribute to the generation of consciously seen 3D surfaces. The first research stream models how processes like 3D boundary grouping and surface filling-in interact in multiple stages within and between the V1 interblob-V2 interstripe-V4 cortical stream and the V1 blob-V2 thin stripe-V4 cortical stream, respectively. Of particular importance for understanding figure-ground separation is how these cortical interactions convert computationally complementary boundary and surface mechanisms into a consistent conscious percept, including the critical use of surface contour feedback signals from surface representations in V2 thin stripes to boundary representations in V2 interstripes. Remarkably, key figure-ground properties emerge from these feedback interactions. The second research stream shows how cells that compute absolute disparity in cortical area V1 are transformed into cells that compute relative disparity in cortical area V2. Relative disparity is a more invariant measure of an object's depth and 3D shape, and is sensitive to figure-ground properties.

psychology, multidisciplinary
Assessing Depth Perception in Virtual Environments: A Comprehensive Framework

Sahra K. G. Silva,Cléber G. Corrêa,Silvio R. R. Sanches,Marcelo S. Lauretto,Fátima L. S. Nunes

DOI: https://doi.org/10.5753/jis.2023.3515

2024-01-01

Journal on Interactive Systems

Abstract:Understanding humans’ perception of depth and how they interact with virtual environments is a challenging task. This context involves investigating how features of these environments affect depth perception, which is crucial for tasks like object manipulation and navigation that require interpreting spatial information. This article presents a comprehensive (general, extensible and flexible) framework to assess depth perception in different virtual environments to support the development of more effective and immersive virtual experiences. This approach can assist developers in decision-making regarding different approaches for assessing depth perception in virtual environments, considering stereoscopic and monoscopic techniques for visualization. The framework considers parameters such as the distance between the user and virtual objects and the sizes of virtual objects. Metrics such as hit rate, response time, and presence questionnaire responses were utilized to assess depth perception. The previous experiments are presented (anaglyph and shutter glasses), as well as the new experiments, considering cave environments with and without anaglyph glasses.
Single View Depth Estimation from Examples

Tal Hassner,Ronen Basri

DOI: https://doi.org/10.48550/arXiv.1304.3915

2013-04-14

Abstract:We describe a non-parametric, "example-based" method for estimating the depth of an object, viewed in a single photo. Our method consults a database of example 3D geometries, searching for those which look similar to the object in the photo. The known depths of the selected database objects act as shape priors which constrain the process of estimating the object's depth. We show how this process can be performed by optimizing a well defined target likelihood function, via a hard-EM procedure. We address the problem of representing the (possibly infinite) variability of viewing conditions with a finite (and often very small) example set, by proposing an on-the-fly example update scheme. We further demonstrate the importance of non-stationarity in avoiding misleading examples when estimating structured shapes. We evaluate our method and present both qualitative as well as quantitative results for challenging object classes. Finally, we show how this same technique may be readily applied to a number of related problems. These include the novel task of estimating the occluded depth of an object's backside and the task of tailoring custom fitting image-maps for input depths.

Computer Vision and Pattern Recognition
Image Characterization and Classification by Physical Complexity

Hector Zenil,Jean-Paul Delahaye,Cedric Gaucherel

DOI: https://doi.org/10.48550/arXiv.1006.0051

2011-07-03

Abstract:We present a method for estimating the complexity of an image based on Bennett's concept of logical depth. Bennett identified logical depth as the appropriate measure of organized complexity, and hence as being better suited to the evaluation of the complexity of objects in the physical world. Its use results in a different, and in some sense a finer characterization than is obtained through the application of the concept of Kolmogorov complexity alone. We use this measure to classify images by their information content. The method provides a means for classifying and evaluating the complexity of objects by way of their visual representations. To the authors' knowledge, the method and application inspired by the concept of logical depth presented herein are being proposed and implemented for the first time.

Computational Complexity,Information Theory
Playing for Depth

Mohammad Mahdi Haji-Esmaeili,Gholamali Montazer

DOI: https://doi.org/10.48550/arXiv.1810.06268

2018-10-15

Abstract:Estimating the relative depth of a scene is a significant step towards understanding the general structure of the depicted scenery, the relations of entities in the scene and their interactions. When faced with the task of estimating depth without the use of Stereo images, we are dependent on the availability of large-scale depth datasets and high-capacity models to capture the intrinsic nature of depth. Unfortunately, creating datasets of depth images is not a trivial task as the requirements for the camera mainly limits us to areas where we can provide the necessities for the camera to work. In this work, we present a new depth dataset captured from Video Games in an easy and reproducible way. The nature of open-world video games gives us the ability to capture high-quality depth maps in the wild without the constrictions of Stereo cameras. Experiments on this dataset shows that using such synthetic datasets increases the accuracy of Monocular Depth Estimation in the wild where other approaches usually fail to generalize.

Computer Vision and Pattern Recognition
Improved Depth Perception of Single-view Images

Jae-Il Jung,Jong-Ho Lee,In-Yong Shin,Ji-Hee Moon,Yo-Sung Ho

DOI: https://doi.org/10.37936/ecti-eec.201082.172089

2019-02-13

Abstract:In many situations, we perceive 3-D depth feeling from 2-D images. Among various depth cues, monocular depth cues make us perceive depth from single-view images. In this paper, we propose several methods to enhance monocular depth cues and improve depth perception of single-view images. The proposed methods deal with four depth cues: linear perspective, aerial perspective, focus, and shadow effects. Once we have a 2-D colour image and its corresponding depth information, we can modify its depth cues and enhance 3-D depth perception in the 2-D image. Experimental results show that the proposed methods can enhance depth perception of single-view images without any considerable visual distortions.

The perception of depth in simple figures

Assessment of Perceptual Depth Intensity on Source Stereoscopic Images

Distance Deception by Fragmented Objects: How Figures May Alter the Perceived Depth of the Background

Depth Compression Based on Mis-Scaling of Binocular Disparity May Contribute to Angular Expansion in Perceived Optical Slant.

On the anisotropy of perceived ground extents and the interpretation of walked distance as a measure of perception.

Correlated Effects of Relative Size and Depth in the Perceptual Organization of Multiple Figure-Ground Configurations

Towards Quantifying Depth and Size Perception in Virtual Environments

3D computational modeling and perceptual analysis of kinetic depth effects

Depth perception of stereoscopic transparent stimuli with frame manipulation

Depth from Defocus in the Wild.

Stereoscopic Depth Perception Through Foliage

Reversed Depth in Anticorrelated Random-Dot Stereograms and the Central-Peripheral Difference in Visual Inference.

Edge highlighting of laser-scanned point clouds improves the accuracy of perceived depth in transparent multi-view 3D visualizations

Impact of Background, Foreground, and Manipulated Object Rendering on Egocentric Depth Perception in Virtual and Augmented Indoor Environments

Lung Cancer Imaging: Remember the Patient.

Cortical Dynamics of Figure-Ground Separation in Response to 2D Pictures and 3D Scenes: How V2 Combines Border Ownership, Stereoscopic Cues, and Gestalt Grouping Rules

Assessing Depth Perception in Virtual Environments: A Comprehensive Framework

Single View Depth Estimation from Examples

Image Characterization and Classification by Physical Complexity

Playing for Depth

Improved Depth Perception of Single-view Images