Abstract:Effective Adaptive BitRate (ABR) algorithm or policy is of paramount importance for Real-Time Video Communication (RTVC) amid this pandemic to pursue uncompromised quality of experience (QoE). Existing ABR methods mainly separate the network bandwidth estimation and video encoder control, and fine-tune video bitrate towards estimated bandwidth, assuming the maximization of bandwidth utilization yields the optimal QoE. However, the QoE of a RTVC system is jointly determined by the quality of compressed video, fluency of video playback, and interaction delay. Solely maximizing the bandwidth utilization without comprehensively considering compound impacts incurred by both network and video application layers, does not assure the satisfactory QoE. And the decoupling of network and video layer further exacerbates the user experience due to network-codec incoordination. This work therefore proposes the Palette, a reinforcement learning based ABR scheme that unifies the processing of network and video application layers to directly maximize the QoE formulated as the weighted function of video quality, stalling rate and delay. To this aim, a cross-layer optimization is proposed to derive fine-grained compression factor of upcoming frame(s) using cross-layer observations like network conditions, video encoding parameters, and video content complexity. As a result, Palette manages to resolve the network-codec incoordination and to best catch up with the network fluctuation. Compared with state-of-the-art schemes in real-world tests, Palette not only reduces 3.1%-46.3% of the stalling rate, 20.2%-50.8% of the delay, but also improves 0.2%-7.2% of the video quality with comparable bandwidth consumption, under a variety of application scenarios.

VASE: Enhancing Adaptive Bitrate Selection for VBR-Encoded Audio and Video Content with Deep Reinforcement Learning

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

Improving ABR Performance for Short Video Streaming Using Multi-Agent Reinforcement Learning with Expert Guidance

Anableps: Adapting Bitrate for Real-Time Communication Using VBR-encoded Video

Joint QoS Control and Bitrate Selection for Video Streaming Based on Multi-agent Reinforcement Learning

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

PPO-ABR: Proximal Policy Optimization based Deep Reinforcement Learning for Adaptive BitRate streaming

Improving Quality of Experience by Adaptive Video Streaming with Super-Resolution

FedABR: A Personalized Federated Reinforcement Learning Approach for Adaptive Video Streaming.

Optimizing Adaptive Video Streaming with Human Feedback

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Deep Reinforcement Learning with Importance Weighted A3C for QoE enhancement in Video Delivery Services

QAVA: QoE-Aware Adaptive Video Bitrate Aggregation for HTTP Live Streaming Based on Smart Edge Computing

Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network

Tiyuntsong: A Self-Play Reinforcement Learning Approach for ABR Video Streaming

Buffer Awareness Neural Adaptive Video Streaming for Avoiding Extra Buffer Consumption.

Improving Adaptive Real-Time Video Communication Via Cross-layer Optimization

ABRF: Adaptive BitRate-FEC Joint Control for Real-Time Video Streaming

Quality-Driven Adaptive Video Streaming for Cognitive VANETs