Abstract:Adaptive Bitrate (ABR) algorithms have become increasingly important for delivering high-quality video content over fluctuating networks. Considering the complexity of video scenes, video chunks can be separated into two categories: those with intricate scenes and those with simple scenes. In practice, it has been observed that improving the quality of intricate chunks yields more substantial improvements in Quality of Experience (QoE) compared with focusing solely on simple chunks. However, the current ABR schemes either treat all chunks equally or rely on fixed linear-based reward functions, which limits their ability to meet real-world requirements. To tackle these limitations, this paper introduces a novel ABR approach called CAST (Complex-scene Aware bitrate algorithm via Self-play reinforcemenT learning), which considers the scene complexity and formulates the bitrate adaptation task as an explicit objective. Leveraging the power of parallel computing with multiple agents, CAST trains a neural network to achieve superior video playback quality for intricate scenes while minimizing playback freezing time. Moreover, we also introduce a new variant of our proposed approach called CAST-DU, to address the critical issue of efficiently managing users' limited cellular data budgets while ensuring a satisfactory viewing experience. Furthermore, we present CAST-Live, tailored for live streaming scenarios with constrained playback buffers and considerations for energy costs. Extensive trace-driven evaluations and subjective tests demonstrate that CAST, CAST-DU, and CAST-Live outperform existing off-the-shelf schemes, delivering a superior video streaming experience over fluctuating networks while efficiently utilizing data resources. Moreover, CAST-Live demonstrates effectiveness even under limited buffer size constraints while incurring minimal energy costs.

Neural Adaptive Transport Framework for Internet-scale Interactive Media Streaming Services

A New Bandwidth Prediction Based Wireless Ad-Hoc Video Communication

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

HyperRTV: Neural-Enhanced Adaptive Real-Time Video Streaming Based on Terminal-Edge Collaboration.

Optimizing Video Streaming in Dynamic Networks: An Intelligent Adaptive Bitrate Solution Considering Scene Intricacy and Data Budget

An Intelligent Learning Approach to Achieve Near-Second Low-Latency Live Video Streaming under Highly Fluctuating Networks

ANT: Learning Accurate Network Throughput for Better Adaptive Video Streaming

Modeling Dynamic Adaptive Streaming Over Information-Centric Networking

Multiuser Video Streaming Rate Adaptation: A Physical Layer Resource-Aware Deep Reinforcement Learning Approach

Receiver Sender Packet Transmission Packet Reception Video Decoder Video Quality Prediction Network Video Quality Reinforcement Learning Video Streaming Session Noise Filter Video Encoder Present Video Frames Video Quality Predicted Bitrate Selection QARC Future Time Feedback Message

Adaptive Bitrate Streaming in Wireless Networks With Transcoding at Network Edge Using Deep Reinforcement Learning

Multi-User Adaptive Video Delivery over Wireless Networks: A Physical Layer Resource-Aware Deep Reinforcement Learning Approach

QOE-Based Neural Live Streaming Method with Continuous Dynamic Adaptive Video Quality Control

A Prediction-Based Traffic Scheduling Framework for Multimedia Services in Dynamic Networks

Neural adaptive IoT streaming analytics with RL-Adapt

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

An Adaptive Cross-Layer Mechanism of Multi-channel Multi-interface Wireless Networks for Real-Time Video Streaming

Delay-Constrained Rate Control for Real-Time Video Streaming with Bounded Neural Network

Improving Generalization for Neural Adaptive Video Streaming Via Meta Reinforcement Learning

Scalable Video Coding and Transport over Broad-Band Wireless Networks