Abstract:Effective Adaptive BitRate (ABR) algorithm or policy is of paramount importance for Real-Time Video Communication (RTVC) amid this pandemic to pursue uncompromised quality of experience (QoE). Existing ABR methods mainly separate the network bandwidth estimation and video encoder control, and fine-tune video bitrate towards estimated bandwidth, assuming the maximization of bandwidth utilization yields the optimal QoE. However, the QoE of a RTVC system is jointly determined by the quality of compressed video, fluency of video playback, and interaction delay. Solely maximizing the bandwidth utilization without comprehensively considering compound impacts incurred by both network and video application layers, does not assure the satisfactory QoE. And the decoupling of network and video layer further exacerbates the user experience due to network-codec incoordination. This work therefore proposes the Palette, a reinforcement learning based ABR scheme that unifies the processing of network and video application layers to directly maximize the QoE formulated as the weighted function of video quality, stalling rate and delay. To this aim, a cross-layer optimization is proposed to derive fine-grained compression factor of upcoming frame(s) using cross-layer observations like network conditions, video encoding parameters, and video content complexity. As a result, Palette manages to resolve the network-codec incoordination and to best catch up with the network fluctuation. Compared with state-of-the-art schemes in real-world tests, Palette not only reduces 3.1%-46.3% of the stalling rate, 20.2%-50.8% of the delay, but also improves 0.2%-7.2% of the video quality with comparable bandwidth consumption, under a variety of application scenarios.

Deepmpc: A Mixture Abr Approach Via Deep Learning and Mpc

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Improving the Performance of Online Bitrate Adaptation with Multi-Step Prediction Over Cellular Networks

Uncertainty-aware Robust Adaptive Video Streaming with Bayesian Neural Network and Model Predictive Control

Buffer Awareness Neural Adaptive Video Streaming for Avoiding Extra Buffer Consumption.

Practically Deploying Heavyweight Adaptive Bitrate Algorithms With Teacher-Student Learning

MADRL-Based Rate Adaptation for 360° Video Streaming with Multi-Viewpoint Prediction

Beyond QoE: Diversity Adaptation in Video Streaming at the Edge.

PRIOR: Deep Reinforced Adaptive Video Streaming with Attention-Based Throughput Prediction

MADRL-Based Rate Adaptation for 360° Video Streaming With Multiviewpoint Prediction

A Novel Framework Combining MPC and Deep Reinforcement Learning With Application to Freeway Traffic Control

Mamba: Bringing Multi-Dimensional ABR to WebRTC

Improving Adaptive Real-Time Video Communication Via Cross-layer Optimization

Trace-Driven Optimization on Bitrate Adaptation for Mobile Video Streaming

Improving Robustness of DASH Against Network Uncertainty

MultiLive: Adaptive Bitrate Control for Low-Delay Multi-Party Interactive Live Streaming

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Enhancing Low Latency Adaptive Live Streaming Through Precise Bandwidth Prediction

PPO-ABR: Proximal Policy Optimization based Deep Reinforcement Learning for Adaptive BitRate streaming

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

ANT: Learning Accurate Network Throughput for Better Adaptive Video Streaming