Abstract:The quality of Virtual Reality (VR) apps is vital, particularly the rendering quality of the VR Graphical User Interface (GUI). Different from traditional 2D apps, VR apps create a 3D digital scene for users, by rendering two distinct 2D images for the user's left and right eyes, respectively. Stereoscopic visual inconsistency (denoted as "SVI") issues, however, undermine the rendering process of the user's brain, leading to user discomfort and even adverse health effects. Such issues commonly exist but remain underexplored. We conduct an empirical analysis on 282 SVI bug reports from 15 VR platforms, summarizing 15 types of manifestations. The empirical analysis reveals that automatically detecting SVI issues is challenging, mainly because: (1) lack of training data; (2) the manifestations of SVI issues are diverse, complicated, and often application-specific; (3) most accessible VR apps are closed-source commercial software. Existing pattern-based supervised classification approaches may be inapplicable or ineffective in detecting the SVI issues. To counter these challenges, we propose an unsupervised black-box testing framework named StereoID to identify the stereoscopic visual inconsistencies, based only on the rendered GUI states. StereoID generates a synthetic right-eye image based on the actual left-eye image and computes distances between the synthetic right-eye image and the actual right-eye image to detect SVI issues. We propose a depth-aware conditional stereo image translator to power the image generation process, which captures the expected perspective shifts between left-eye and right-eye images. We build a large-scale unlabeled VR stereo screenshot dataset with larger than 171K images from 288 real-world VR apps for experiments. After substantial experiments, StereoID demonstrates superior performance for detecting SVI issues in both user reports and wild VR apps.

Fundamentals of Stereoscopic 3D Game Design

Hybrid-Dimensional Visualization and Interaction - Integrating 2D and 3D Visualization with Semi-Immersive Navigation Techniques

Literary and Historical 3D Digital Game—Based Learning: Design Guidelines

Directions for 3D User Interface Research from Consumer VR Games

Stereoscopic Cinema

Interactive 3-DTV-Concepts and Key Technologies

3D Video Representation and Design for Ubiquitous Environments

Stereo vision based 3D game interface

The same video game in 2D, 3D or virtual reality – How does technology impact game evaluation and brand placements?

Advances in Interaction with 3D Environments

3D-TV System with Depth-Image-Based Rendering: Architectures, Techniques and Challenges

Mixed Design in Reality: How to translate a VR Game to a MR World and What’s some design issues about it?

A New Method for Analysis and Design of Stereoscopic System

Stereoscopic 3D Geometric Distortions Analyzed from the Viewer's Point of View.

Outstanding: A Multi-Perspective Travel Approach for Virtual Reality Games

Video Game Design for Learning to Learn

A Systematic Literature Review on the User Experience Design for Game-Based Interventions via 3D Virtual Worlds in K-12 Education

Developing and Testing a 3D Video Game for Construction Safety Education

From Content to Context: Videogames as Designed Experience

Stereoscopic 3D Web: From idea to implementation

Less Cybersickness, Please: Demystifying and Detecting Stereoscopic Visual Inconsistencies in Virtual Reality Apps