Abstract:Effective Adaptive BitRate (ABR) algorithm or policy is of paramount importance for Real-Time Video Communication (RTVC) amid this pandemic to pursue uncompromised quality of experience (QoE). Existing ABR methods mainly separate the network bandwidth estimation and video encoder control, and fine-tune video bitrate towards estimated bandwidth, assuming the maximization of bandwidth utilization yields the optimal QoE. However, the QoE of a RTVC system is jointly determined by the quality of compressed video, fluency of video playback, and interaction delay. Solely maximizing the bandwidth utilization without comprehensively considering compound impacts incurred by both network and video application layers, does not assure the satisfactory QoE. And the decoupling of network and video layer further exacerbates the user experience due to network-codec incoordination. This work therefore proposes the Palette, a reinforcement learning based ABR scheme that unifies the processing of network and video application layers to directly maximize the QoE formulated as the weighted function of video quality, stalling rate and delay. To this aim, a cross-layer optimization is proposed to derive fine-grained compression factor of upcoming frame(s) using cross-layer observations like network conditions, video encoding parameters, and video content complexity. As a result, Palette manages to resolve the network-codec incoordination and to best catch up with the network fluctuation. Compared with state-of-the-art schemes in real-world tests, Palette not only reduces 3.1%-46.3% of the stalling rate, 20.2%-50.8% of the delay, but also improves 0.2%-7.2% of the video quality with comparable bandwidth consumption, under a variety of application scenarios.

COCKTAIL: Video streaming QoE optimization with chunk replacement and guided learning

QoE-Aware Dynamic Video Rate Adaptation

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

PPO-ABR: Proximal Policy Optimization based Deep Reinforcement Learning for Adaptive BitRate streaming

Joint QoS Control and Bitrate Selection for Video Streaming Based on Multi-agent Reinforcement Learning

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

Improving Adaptive Real-Time Video Communication Via Cross-layer Optimization

Learning-based Joint QoE Optimization for Adaptive Video Streaming based on Smart Edge

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

Beyond QoE: Diversity Adaptation in Video Streaming at the Edge.

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Quality-Aware Neural Adaptive Video Streaming With Lifelong Imitation Learning

Adaptive QoE‐based video delivery by optimizing the bitrate of the video course using network bandwidth and user bandwidth

Improving ABR Performance for Short Video Streaming Using Multi-Agent Reinforcement Learning with Expert Guidance

User-Perceived QoE Adaptation for Accelerated Playback in Mobile Video Streaming

Imitation Learning for Adaptive Video Streaming with Future Adversarial Information Bottleneck Principle

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

QoE-Oriented Rate Adaptation for DASH with Enhanced Deep Q-Learning

Adaptive Bitrate with User-level QoE Preference for Video Streaming

Comyco: Quality-Aware Adaptive Video Streaming via Imitation Learning

FedABR: A Personalized Federated Reinforcement Learning Approach for Adaptive Video Streaming.