Q-STAR + : A Perceptual Quality Model for Viewport-Based Immersive Video Streaming
Yu Meng,Zhan Ma,Xun Cao,Qiu Shen
2018-01-01
Abstract:Users typically wear the head mounted display (HMD) to navigate and enjoy the immersive video content. In practice, a viewport-based immersive video streaming strategy is intuitively preferred for constrained network bandwidth, but it still lacks of a theoretical framework to resolve this fundamental bandwidth-quality optimization problem. Therefore, in this work, we have developed an analytical model, so called “Q-STAR+”, to connect the perceptual quality of a compressed viewport video (viewed via wearing the HMD) with respect to its Spatial (frame size), Temporal (frame rate), and Amplitude (quantization) Resolutions (STAR). There are overall four parameters that can be easily extracted from the content itself. The complete model correlates well with the mean opinion scores (MOS) with a Pearson Correlation Coefficient (PCC) of 0.95, and a Spearman’s Rank Correlation Coefficient (SRCC) of 0.95, according to an independent validation test, yielding the stateof-the-art performance in comparison to those famous objective quality metrics (e.g., MS-SSIM [1], VIFP [2], FSIM [3], and VSI [4]). Together with the rate model, we could make the perceptual optimized viewport video streaming of immersive content analytical tractable, so as to maximize the visual quality subjectively under any given network bandwidth constraint.