Abstract:Viewport-adaptive streaming approaches are emerging as the most promising way to deliver high-quality 360(circle) videos. The viewport prediction techniques are developed to reduce bandwidth waste and improve users' Quality of Experience (QoE). However, the viewport prediction result is only reliable with a short prediction window, i.e., a short playback buffer, which conflicts with maintaining a long buffer to minimize the stall ratio. To deal with this problem, we present RAM360, a Robust Adaptive Multi-layer 360(circle) video streaming system, to ensure high viewport quality and low stall ratio concurrently. We make three technical contributions. First, we design a QoE-driven robust multi-layer streaming framework, where each chunk is encoded into multiple independent layers with different quality levels. The client can dynamically decide which chunk and which layer to download according to their QoE contributions. Thus, the client can enhance the low-quality chunks (including the mistakenly predicted ones) in time to improve the viewport quality. Meanwhile, the client can adaptively download new chunks to the buffer to decrease the risk of stall. Second, we establish a novel model as users' QoE metric throughout the playback progress, aiming to guide the client's download theoretically. Third, we utilize the Lyapunov optimization theory to solve the QoE optimization problem online while assuring our algorithm's near-optimality. We demonstrate that RAM360 can significantly outperform the existing schemes regarding the QoE (related to viewport quality, viewport quality oscillation, and stall ratio) through extensive experiments on public datasets.

Personalized 360-Degree Video Streaming: A Meta-Learning Approach

Personalized 360-Degree Video Streaming

Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

MetaLive: Meta-Reinforcement Learning Based Collective Bitrate Adaptation for Multi-Party Live Streaming

Synergistic Temporal-Spatial User-Aware Viewport Prediction for Optimal Adaptive 360-Degree Video Streaming

Optimizing Mobile-Friendly Viewport Prediction for Live 360-Degree Video Streaming

MetaLive: Meta-Reinforcement Learning Based Collective Bitrate Adaptation for Multi-Party Live Streaming.

DRL360: 360-Degree Video Streaming with Deep Reinforcement Learning

CUB360: Exploiting Cross-Users Behaviors for Viewport Prediction in 360 Video Adaptive Streaming

MADRL-Based Rate Adaptation for 360° Video Streaming With Multiviewpoint Prediction

Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network

Viewport Prediction, Bitrate Selection, and Beamforming Design for THz-Enabled 360° Video Streaming

TVG-Streaming : Learning User Behaviors for QoE-Optimized 360-Degree Video Streaming

Personalized QoE Enhancement for Adaptive Video Streaming: A Digital Twin-Assisted Scheme

MADRL-Based Rate Adaptation for 360° Video Streaming with Multi-Viewpoint Prediction

PAAS: a preference-aware deep reinforcement learning approach for 360° video streaming

A Meta-Learning Framework for Learning Multi-User Preferences in QoE Optimization of DASH

RAM360: Robust Adaptive Multi-Layer 360$^\circ$ Video Streaming with Lyapunov Optimization.

Towards Optimal Real-time Volumetric Video Streaming: A Rolling Optimization and Deep Reinforcement Learning Based Approach