Abstract:In the tile-based panoramic video streaming, the Field of View (FOV) is composed of multiple real-time synchronized visible video tiles. The common panoramic video transmission control methods use the FOV prediction and redundant tile transmission to address the issues of network delay and fast viewport switching. However, these methods rely heavily on the FOV prediction accuracy and do not fully consider the transmission efficiency, which is measured by the ratio of data used for FOV to the total transmitted data. Moreover, the existing learning-based methods directly consider the ever-changing factors such as network bandwidth and viewport position in the learning process, resulting in the poor stability of the transmission control. In this paper, we propose a Deep Reinforcement Learning (DRL)-based transmission control method for the tile-based panoramic video streaming, and the objective is to optimize the transmission efficiency on the basis of the guaranteed Quality of Experience (QoE). Firstly, we define the panoramic video transmission control process as the maximization of transmission efficiency on the basis of constraining multiple QoE metrics in the preset acceptable ranges. Secondly, we design a two-stage transmission control decision-making mechanism to improve the stability of transmission process, which includes intermediate decision-making stage and final decision-making stage. During the intermediate decision-making stage, the newly defined aggregated transmission decision variables are learned by using the Rainbow Deep Q Network. In this online learning process, we only consider the QoE and transmission efficiency, and avoid directly involving the ever-changing environment factors. During the final decision-making stage, the bitrate and buffer size of each video tile are determined according to the network bandwidth and viewport under the guidance of the intermediate decisions. Finally, the experiments conducted with the actual network bandwidth and viewport track show that our method performs better in the long-term transmission efficiency than other methods.

Bamboo: Boosting Training Efficiency for Real-Time Video Streaming via Online Grouped Federated Transfer Learning

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Towards Optimal Real-time Volumetric Video Streaming: A Rolling Optimization and Deep Reinforcement Learning Based Approach

Adaptive Batchsize Selection and Gradient Compression for Wireless Federated Learning

Over-the-air Learning Rate Optimization for Federated Learning

From Ember to Blaze: Swift Interactive Video Adaptation via Meta-Reinforcement Learning

Learning-Based Online QoE Optimization in Multi-Agent Video Streaming

Frame-Level Video Caching and Transmission Scheduling Via Stochastic Learning

DRL-based transmission control for QoE guaranteed transmission efficiency optimization in tile-based panoramic video streaming

Deep Reinforcement Learning Based Adaptive 360-Degree Video Streaming with Field of View Joint Prediction

DL-assisted Tradeoff Design for Multi-Uav Real-Time Video Streaming Transmission

FedABR: A Personalized Federated Reinforcement Learning Approach for Adaptive Video Streaming.

Deep Reinforcement Learning-based Rate Adaptation for Adaptive 360-Degree Video Streaming

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

Mamba: Bringing Multi-Dimensional ABR to WebRTC

Learning-based Joint QoE Optimization for Adaptive Video Streaming based on Smart Edge

Robust Saliency-Driven Quality Adaptation for Mobile 360-Degree Video Streaming

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

Toward Optimal Live Video Streaming QoE: A Deep Feature-Fusion Approach

Personalized 360-Degree Video Streaming

Joint online transcoding and geo-distributed delivery for dynamic adaptive streaming