Abstract:Instead of streaming the entire OmniDirectional Videos (ODVs) that are often sampled at ultra high definition and high frame rate, a viewport adaptive streaming is preferred in practice. We usually stream the High-Quality (HQ) content within current viewport, while Low-Quality (LQ) elsewhere to save the network bandwidth consumption. Such scheme would lead to a quality refinement after user adapts his/her focus to a new viewport. In this paper, we thus model the perceptual impact of the quality variations (through adjusting the Quantization Stepsize (QS or q) and Spatial Resolution (SR or s)) with respect to the Refinement Duration (RD or tau) when performing the refinement from an arbitrary LQ scale to an arbitrary HQ one. A number of quality variations are studied to cover sufficient use cases in practice, resulting in a unified analytical model, as a product of separable exponential functions that measure the QS and SR induced perceptual impacts in terms of the RD, and a perceptual index measuring the subjective quality of corresponding viewport video after refinement. This model is first validated in a managed lab environment via independent subjective assessments by constraining user's navigation to avoid unexpected noise, where both Pearson Correlation Coefficient (PCC) and Spearman's Rank Correlation Coefficient (SRCC) are around 0.97. We then extend the validations in a real-life viewport-dependent streaming system, still yielding PCC and SRCC about 0.96 when comparing collected subjective scores with model predictions.

Modeling Peripheral Vision Impact on Perceptual Quality of Immersive Images

Perceptual Quality Assessment of Immersive Images Considering Peripheral Vision Impact

Modeling the Impact of Spatial Resolutions on Perceptual Quality of Immersive Image/video.

Modeling the Non-Uniform Retinal Perception for Viewport-Dependent Streaming of Immersive Video

Modeling the Perceptual Quality of Immersive Images Rendered on Head Mounted Displays: Resolution and Compression

Modeling the Perceptual Impact of Viewport Adaptation for Immersive Video.

Assessment of Perceptual Depth Intensity on Source Stereoscopic Images

Viewport Adaptation-Based Immersive Video Streaming: Perceptual Modeling and Applications.

Spatial Perceptual Quality Aware Adaptive Volumetric Video Streaming

Study of 3D Virtual Reality Picture Quality

Modeling the Perceptual Quality of Viewport Adaptive Omnidirectional Video Streaming

The Effects of Peripheral Vision and Light Stimulation on Distance Judgments Through HMDs

Perceptual Quality Assessment of Virtual Reality Videos in the Wild

Perceptual Quality Assessment of Omnidirectional Images

Foveated Light-Field Display and Real-Time Rendering for Virtual Reality

Towards Quality of Experience Determination for Video in Augmented Binocular Vision Scenarios

Q-STAR + : A Perceptual Quality Model for Viewport-Based Immersive Video Streaming

Non-reference Virtual View Quality Evaluation of MVD

Omnidirectional Virtual Visual Acuity: A User-Centric Visual Clarity Metric for Virtual Reality Head-Mounted Displays and Environments

Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images