Abstract:Adaptive Bitrate (ABR) algorithms have become increasingly important for delivering high-quality video content over fluctuating networks. Considering the complexity of video scenes, video chunks can be separated into two categories: those with intricate scenes and those with simple scenes. In practice, it has been observed that improving the quality of intricate chunks yields more substantial improvements in Quality of Experience (QoE) compared with focusing solely on simple chunks. However, the current ABR schemes either treat all chunks equally or rely on fixed linear-based reward functions, which limits their ability to meet real-world requirements. To tackle these limitations, this paper introduces a novel ABR approach called CAST (Complex-scene Aware bitrate algorithm via Self-play reinforcemenT learning), which considers the scene complexity and formulates the bitrate adaptation task as an explicit objective. Leveraging the power of parallel computing with multiple agents, CAST trains a neural network to achieve superior video playback quality for intricate scenes while minimizing playback freezing time. Moreover, we also introduce a new variant of our proposed approach called CAST-DU, to address the critical issue of efficiently managing users' limited cellular data budgets while ensuring a satisfactory viewing experience. Furthermore, we present CAST-Live, tailored for live streaming scenarios with constrained playback buffers and considerations for energy costs. Extensive trace-driven evaluations and subjective tests demonstrate that CAST, CAST-DU, and CAST-Live outperform existing off-the-shelf schemes, delivering a superior video streaming experience over fluctuating networks while efficiently utilizing data resources. Moreover, CAST-Live demonstrates effectiveness even under limited buffer size constraints while incurring minimal energy costs.

RAV: Learning-Based Adaptive Streaming to Coordinate the Audio and Video Bitrate Selections

Learning Audio and Video Bitrate Selection Strategies Via Explicit Requirements

VASE: Enhancing Adaptive Bitrate Selection for VBR-Encoded Audio and Video Content with Deep Reinforcement Learning

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

Adaptive Video Streaming Based on Learning Intrinsic Reward

A Learning-Based Approach for Video Streaming over Fluctuating Networks with Limited Playback Buffers

Optimizing Video Streaming in Dynamic Networks: An Intelligent Adaptive Bitrate Solution Considering Scene Intricacy and Data Budget

Anableps: Adapting Bitrate for Real-Time Communication Using VBR-encoded Video

CAST: an Intricate-Scene Aware Adaptive Bitrate Approach for Video Streaming Via Parallel Training.

Survey on Reinforcement Learning Based Adaptive Bit Rate Algorithm for Mobile Video Streaming Services

VAMP: A Predictive Approach to Audio/Video Bitrate Adaptation over Wireless Networks

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

DAVS: Dynamic-Chunk Quality Aware Adaptive Video Streaming Using Apprenticeship Learning

An Apprenticeship Learning Approach for Adaptive Video Streaming Based on Chunk Quality and User Preference.

Improving Generalization for Neural Adaptive Video Streaming Via Meta Reinforcement Learning

Joint QoS Control and Bitrate Selection for Video Streaming Based on Multi-agent Reinforcement Learning

Adaptive Bitrate Streaming in Wireless Networks With Transcoding at Network Edge Using Deep Reinforcement Learning

Adaptive Bitrate with User-level QoE Preference for Video Streaming

Improving ABR Performance for Short Video Streaming Using Multi-Agent Reinforcement Learning with Expert Guidance