Abstract:This article first provides a new Viewport-based OmniDirectional Video Quality Assessment (VOD-VQA) database, which includes eighteen salient viewport videos extracted from the original OmniDirectional Videos (ODVs), and corresponding 774 impaired samples generated by compressing the raw viewports using a variety of combinations of its Spatial (frame size s), Temporal (frame rate t), and Amplitude (quantization stepsize q) Resolutions (STAR). Total 160 subjects have assessed the processed viewport videos rendered on the head mounted display (HMD) when they stabilize their fixations. We then have formulated an analytical model to connect the perceptual quality of a compressed viewport video with its STAR variables, noted as the QVP STAR index. All four model parameters can be predicted using linearly weighted content features, making the proposed metric generalized to various contents. This model correlates well with the mean opinion scores (MOSs) collected for processed viewport videos, having both the Pearson Correlation Coefficient and Spearman's Rank Correlation Coefficient (SRCC) at 0.95 according to an independent validation test, yielding the state-of-the-art performance in comparison to those popular objective metrics (e.g., Weighted to Spherically uniform (WS)-Peak Signal to Noise Ratio (PSNR), WMS-SSIM, Video Multimethod Assessment Fusion (VMAF), Feature SIMilarity Index (FSIM), and Visual Saliency based IQA Index (VSI)). Furthermore, this viewport-based quality index Q(STAR)(VP) is extended to infer the overall ODV quality, a. k.a., Q(STAR)(ODV), by linearly weighing the saliency-aggregated qualities of salient viewports and the quality of quick-scanning (or non-salient) area. Experiments have shown that inferred Q(STAR)(ODV) can accurately predict the MOS with competitive performance to the state-ofthe-art algorithm using another four independent and third-party ODV assessment datasets. All related materials are made publicly accessible at https://vision.nju. edu.cn/20/86/c29466a467078/ page.htm for reproducible research.

Attention enabled viewport selection with graph convolution for omnidirectional visual quality assessment

Blind Omnidirectional Image Quality Assessment with Viewport Oriented Graph Convolutional Networks

Omnidirectional Image Quality Assessment by Distortion Discrimination Assisted Multi-Stream Network

Viewport-Based Omnidirectional Video Quality Assessment: Database, Modeling and Inference

Eye Scanpath Prediction-Based No-Reference Quality Assessment of Omnidirectional Images

Perceptual Quality Assessment of Omnidirectional Images

ST360IQ: No-Reference Omnidirectional Image Quality Assessment with Spherical Vision Transformers

Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessment

VSOIQE: A Novel Viewport-Based Stitched 360° Omnidirectional Image Quality Evaluator

Viewport-Sphere-Branch Network for Blind Quality Assessment of Stitched 360° Omnidirectional Images

Viewport-based CNN: A Multi-task Approach for Assessing 360° Video Quality

ResVR: Joint Rescaling and Viewport Rendering of Omnidirectional Images

Perceptual Quality Assessment of Immersive Images Considering Peripheral Vision Impact

Viewport Perception Based Blind Stereoscopic Omnidirectional Image Quality Assessment

FOVQA: Blind Foveated Video Quality Assessment

No-Reference Quality Assessment for 360-degree Images by Analysis of Multi-frequency Information and Local-global Naturalness

AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Images

Viewport Proposal CNN for 360° Video Quality Assessment

Quality Assessment of Super-Resolved Omnidirectional Image Quality Using Tangential Views

Learning High-Quality Navigation and Zooming on Omnidirectional Images in Virtual Reality

Quality Assessment for Virtual View Image Based on Edge Difference