Abstract:Stereoscopic projection mapping (PM) allows a user to see a three-dimensional (3D) computer-generated (CG) object floating over physical surfaces of arbitrary shapes around us using projected imagery. However, the current stereoscopic PM technology only satisfies binocular cues and is not capable of providing correct focus cues, which causes a vergence--accommodation conflict (VAC). Therefore, we propose a multifocal approach to mitigate VAC in stereoscopic PM. Our primary technical contribution is to attach electrically focus-tunable lenses (ETLs) to active shutter glasses to control both vergence and accommodation. Specifically, we apply fast and periodical focal sweeps to the ETLs, which causes the "virtual image'" (as an optical term) of a scene observed through the ETLs to move back and forth during each sweep period. A 3D CG object is projected from a synchronized high-speed projector only when the virtual image of the projected imagery is located at a desired distance. This provides an observer with the correct focus cues required. In this study, we solve three technical issues that are unique to stereoscopic PM: (1) The 3D CG object is displayed on non-planar and even moving surfaces; (2) the physical surfaces need to be shown without the focus modulation; (3) the shutter glasses additionally need to be synchronized with the ETLs and the projector. We also develop a novel compensation technique to deal with the "lens breathing" artifact that varies the retinal size of the virtual image through focal length modulation. Further, using a proof-of-concept prototype, we demonstrate that our technique can present the virtual image of a target 3D CG object at the correct depth. Finally, we validate the advantage provided by our technique by comparing it with conventional stereoscopic PM using a user study on a depth-matching task.

Optical Design of Three-Dimensional Projection on Multifocal Planes

Device and method for 360-degree full-parallax three dimensional display based on high-speed projector

Lightweight Spatial-Multiplexed Dual Focal-Plane Head-Mounted Display Using Two Freeform Prisms

Omnidirectional-view three-dimensional display system based on cylindrical selective-diffusing screen.

Bifocal computational near eye light field displays and Structure parameters determination scheme for bifocal computational display.

Development of a Three-Dimensional Multimode Visual Immersive System With Applications in Telepresence

The Optical System Design of Head-Mounted Display

Multifocal Plane Display Based on Dual Polarity Stereoscopic Metasurface

An Optical See-Through Head Mounted Display with Addressable Focal Planes

Development of a Compact Optical See-Through Head-Mounted Display with Dual Focal Planes and Spatial Multiplexing Using Freeform Prisms

Glasses-Free Large Size High-Resolution Three-Dimensional Display Based On The Projector Array

Design of a dual focal-plane near-eye display using diffractive waveguides and multiple lenses

Wearable Optical See-Through Head-Mounted Display Capable of Adjusting Virtual Image Depth

Optical Design For A Wide Field-Of-View Hmd With High-Resolution Insertion

Projection-Type Multiview Holographic Three-Dimensional Display Using a Single Spatial Light Modulator and a Directional Diffractive Device

Design and Fabrication of a Wide-Angle Off-Axis Three-Mirror Head-Mounted Display System

Design of a dual focal-plane near-eye display using diffractive waveguides and vision-correction lenses

High Performance 3D Light Field Display Based on Distortion Suppressed Compound Lens and Pre-Correction Encoded Image

Super Multi-View Display Based on Pixelated Nanogratings under an Illumination of a Point Light Source

Multifocal Stereoscopic Projection Mapping

Flat-Concave Dual-Mirror Configuration Design for Upright Projection-Type Ultrashort Throw Ratio Projectors