Abstract:Adaptive Bitrate (ABR) algorithms have become increasingly important for delivering high-quality video content over fluctuating networks. Considering the complexity of video scenes, video chunks can be separated into two categories: those with intricate scenes and those with simple scenes. In practice, it has been observed that improving the quality of intricate chunks yields more substantial improvements in Quality of Experience (QoE) compared with focusing solely on simple chunks. However, the current ABR schemes either treat all chunks equally or rely on fixed linear-based reward functions, which limits their ability to meet real-world requirements. To tackle these limitations, this paper introduces a novel ABR approach called CAST (Complex-scene Aware bitrate algorithm via Self-play reinforcemenT learning), which considers the scene complexity and formulates the bitrate adaptation task as an explicit objective. Leveraging the power of parallel computing with multiple agents, CAST trains a neural network to achieve superior video playback quality for intricate scenes while minimizing playback freezing time. Moreover, we also introduce a new variant of our proposed approach called CAST-DU, to address the critical issue of efficiently managing users' limited cellular data budgets while ensuring a satisfactory viewing experience. Furthermore, we present CAST-Live, tailored for live streaming scenarios with constrained playback buffers and considerations for energy costs. Extensive trace-driven evaluations and subjective tests demonstrate that CAST, CAST-DU, and CAST-Live outperform existing off-the-shelf schemes, delivering a superior video streaming experience over fluctuating networks while efficiently utilizing data resources. Moreover, CAST-Live demonstrates effectiveness even under limited buffer size constraints while incurring minimal energy costs.

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

Adaptive video streaming algorithm based on meta-learning

Improving Generalization for Neural Adaptive Video Streaming Via Meta Reinforcement Learning

MetaLive: Meta-Reinforcement Learning Based Collective Bitrate Adaptation for Multi-Party Live Streaming

MetaLive: Meta-Reinforcement Learning Based Collective Bitrate Adaptation for Multi-Party Live Streaming.

FedABR: A Personalized Federated Reinforcement Learning Approach for Adaptive Video Streaming.

Survey on Reinforcement Learning Based Adaptive Bit Rate Algorithm for Mobile Video Streaming Services

Learning Audio and Video Bitrate Selection Strategies Via Explicit Requirements

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

A Learning-Based Approach for Video Streaming over Fluctuating Networks with Limited Playback Buffers

RAV: Learning-Based Adaptive Streaming to Coordinate the Audio and Video Bitrate Selections

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Adaptive Video Streaming Based on Learning Intrinsic Reward

Neural Adaptive Video Streaming with OfflineReinforcement Learning

Joint QoS Control and Bitrate Selection for Video Streaming Based on Multi-agent Reinforcement Learning

Adaptive Bitrate Streaming in Wireless Networks With Transcoding at Network Edge Using Deep Reinforcement Learning

Optimizing Video Streaming in Dynamic Networks: An Intelligent Adaptive Bitrate Solution Considering Scene Intricacy and Data Budget

VASE: Enhancing Adaptive Bitrate Selection for VBR-Encoded Audio and Video Content with Deep Reinforcement Learning

CAST: an Intricate-Scene Aware Adaptive Bitrate Approach for Video Streaming Via Parallel Training.

Latency Aware Adaptive Video Streaming Using Ensemble Deep Reinforcement Learning.