Multi-stream-Based Low-Latency Viewport Switching Scheme for Panoramic Videos.

Yong Wang,Hengyu Man,Xingtao Wang,Xiaopeng Fan

DOI: https://doi.org/10.1007/978-981-99-8552-4_9

2024-01-01

Abstract:Panoramic videos have emerged as a widely-used media format as they provide immersive and interactive experience, but their large resolution and high frame rate pose great challenges for video compression efficiency. The challenges are relieved by tile-based viewport adaptive streaming, in which the viewport switching latency is critical to users’ quality of experience. Existing methods for reducing the switching latency are limited to single high-quality stream. In this paper, we propose a smooth viewport switching strategy, where a panoramic video is encoded into a low-quality stream and multiple high-quality streams. The low-quality stream provides basic quality for the entire video, while the high-quality streams delivery real-time high-quality rendering for the current viewport. The multiple high-quality streams have different starting times during encoding, resulting in interleaved keyframes. These interleaved keyframes serve as random access points when the viewport switches. Smooth switching is achieved through selecting the stream corresponding to the keyframe closest to the switching point. The experimental results show that our method is significantly superior to existing methods.