Abstract:The target view image is composed of background, 3D warping, and reconstruction components. The reconstruction process is guided by the saliency and JND extracted from the right‐eye pre‐rendering. The target view performs high‐spp ray tracing only on representative pixels, thereby avoiding high‐density ray tracing across the entire scene and reducing the computational overhead. Monte Carlo ray tracing can produce high‐fidelity stereo renderings of 3D scenes. However, the computational costs associated with shading indirect illumination can be prohibitively expensive. While techniques like reprojection and reconstruction have been employed to reduce the inherent redundancy in stereo rendering, they often fall short in addressing issues like remaining holes and appearing artifacts, particularly in the case of specular reflections. In this paper, we introduce a stereo rendering method that leverages both ray tracing and 3D warping, incorporating techniques for reusing indirect illumination calculations and perception‐driven reconstructions. At the pre‐rendering stage, we reuse indirect illumination calculations in the background and 3D warping regions, resulting in significant savings of indirect illumination calculations in the testing scenes. For the remaining holes, we adopt a sparse sampling strategy for representative pixels, guided by saliency maps. We iteratively reconstruct indirect illumination, employing a stopping criterion based on just noticeable difference thresholds. Through equal‐sample experiments, we showcase the efficiency achieved by the proposed method in reducing high‐level sampling costs for 87.688% ~ 99.581% regions of the test scenes. Furthermore, the proposed method excels in accurately rendering both diffuse and specular reflections, ultimately enhancing the overall visual perception quality.

Ray tracing-based construction of 3D background model for real-time stereoscopic rendering of live immersive video

Real time stereo rendering for augmented reality on 3DTV system

Web-based virtual walkthrough of panoramas

Real-time Stereo to Multi-View Conversion System Based on Adaptive Meshing

An Accelerated Rendering Algorithm for Stereoscopic Display

Asymmetric representation for 3D panoramic video

A New Virtual View Rendering Method Based on Depth Image

MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images

Asymmetric Circular Projection For Dynamic Virtual Reality Video Stream Switching

Reducing stereo ray‐tracing budget with 3D warping and perception‐driven reconstruction

Depth-image-based Rendering with Spatial and Temporal Texture Synthesis for 3DTV

Towards real-time 3D visualization with multiview RGB camera array

StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videos

Real-time stereoscopic rendering of realistic avatar for interactive 3D telepresence system

Real-Time Walkthrough Of Outdoor Scenes Using Tri-View Morphing

Cloud-to-end Rendering and Storage Management for Virtual Reality in Experimental Education

Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality Streaming

Efficient 3D Reconstruction, Streaming and Visualization of Static and Dynamic Scene Parts for Multi-client Live-telepresence in Large-scale Environments

An End-to-End Real-Time 3D System for Integral Photography Display

Real-time 3DTV System for Autostereoscopic Displays

Real-Time 3D Video Synthesis from Binocular Stereo Camera