Just-Noticeable-Difference Based Coding and Rate Control of Mobile 360° Video Streaming.
Sushu Yang,Peng Yang,Hongkui Wang,Ning Zhang,Li Yu
DOI: https://doi.org/10.1109/globecom46510.2021.9685140
2021-01-01
Abstract:In recent years, 360ovideos have gained higher and higher popularity. Nonetheless, compared to two dimensional videos, the large-scale data volume renders it a bottleneck to deliver 360ocontent with constrained bandwidth resources. In this paper, we investigate user viewing behavior when they explore in immersive environment and propose a novel 360ojust-noticeable-difference (JND) model to characterize user's tolerance to visual distortion. In order to maximize user's quality of experience (QoE), we present a scheme, named JND-Based Streaming (JBS), to jointly optimize 360o video coding and streaming over mobile devices. Specifically, tiled 360ovideos are firstly encoded with the proposed JND model to reduce video file size. Then, a quality-driven streaming approach is designed to instruct tile-level bitrate allocation, considering subjective sensation. Thanks to the video file size reduction, tiles can be delivered with higher quality, which provides users with improved QoE. Experimental results based on real-world network traces demonstrate that, on average, JBS outperforms its counterparts by 12% and 57% in terms of perceived quality.