Abstract:Foveated rendering synthesizes images with progressively less detail outside the eye fixation region, potentially unlocking significant speedups for wide field-of-view displays, such as head mounted displays, where target framerate and resolution is increasing faster than the performance of traditional real-time renderers. To study and improve potential gains, we designed a foveated rendering user study to evaluate the perceptual abilities of human peripheral vision when viewing today's displays. We determined that filtering peripheral regions reduces contrast, inducing a sense of tunnel vision. When applying a postprocess contrast enhancement, subjects tolerated up to 2× larger blur radius before detecting differences from a non-foveated ground truth. After verifying these insights on both desktop and head mounted displays augmented with high-speed gaze-tracking, we designed a perceptual target image to strive for when engineering a production foveated renderer. Given our perceptual target, we designed a practical foveated rendering system that reduces number of shades by up to 70% and allows coarsened shading up to 30° closer to the fovea than Guenter et al. [2012] without introducing perceivable aliasing or blur. We filter both pre- and post-shading to address aliasing from undersampling in the periphery, introduce a novel multiresolution- and saccade-aware temporal antialising algorithm, and use contrast enhancement to help recover peripheral details that are resolvable by our eye but degraded by filtering. We validate our system by performing another user study. Frequency analysis shows our system closely matches our perceptual target. Measurements of temporal stability show we obtain quality similar to temporally filtered non-foveated renderings.

A Novel Foveated-JND Profile Based on an Adaptive Foveated Weighting Model

Feedforward and Feedback Modulations Based Foveated JND Estimation for Images

Foveated JND Model Based on Stereo Vision and Its Application in Image Compression with Hardware Implementation

Asymmetric Foveated Just-Noticeable-Difference Model for Images With Visual Field Inhomogeneities

Perceptual Multiview Video Coding Based On Foveated Just Noticeable Distortion Profile In Dct Domain

A JND guided foveation video coding

Content Adaptive JND Profile by Leveraging HVS Inspired Channel Modeling and Perception Oriented Energy Allocation Optimization

Just-Noticeable-Distortion Profile With Nonlinear Additivity Model For Perceptual Masking In Color Images

Semantically Adaptive JND Modeling with Object-Wise Feature Characterization, Context Inhibition and Cross-Object Interaction

Towards foveated rendering for gaze-tracked virtual reality

Individualized foveated rendering with eye-tracking head-mounted display

Retinotopic Foveated Rendering

Toward Standardized Classification of Foveated Displays

Scene-aware Foveated Neural Radiance Fields

Foveated Light-Field Display and Real-Time Rendering for Virtual Reality

Enhanced Just Noticeable Difference Model for Images With Pattern Complexity

Face Reconstruction Using Fixation Positions and Foveated Imaging

Medical Image Quality Metrics for Foveated Model Observers

Is Foveated Rendering Perceivable in Virtual Reality?: Exploring the Efficiency and Consistency of Quality Assessment Methods.

FOVQA: Blind Foveated Video Quality Assessment

An Α-Matte Boundary Defocus Model Based Cascaded Network for Multi-focus Image Fusion