Abstract:Internet adaptive video streaming is a typical form of video delivery that leverages adaptive bitrate (ABR) algorithms to provide video services with high quality of experience (QoE) for various users in diverse and unique network conditions. Such heterogeneous network environments, which can be viewed as exogenous input processes, often lead to the unstable performance of ABR algorithms. Unfortunately, learning-based ABR algorithm which generated by state-of-the-art reinforcement learning (RL) technologies achieves good average performance but fails to perform well in all kinds of network conditions. In this work, considering the video playback process as the Input-driven Markov Decision Process (IMDP), we propose BR (Adaptation of ABR), a novel meta-RL ABR approach. BR is mainly composed of an online stage and an offline stage. It leverages meta-RL to learn an initial meta-policy with various network conditions at the offline stage and makes decisions in personalized network conditions at the online stage. At the same time, we continually optimize the meta-policy to the tailor-made ABR policy for varying the current network environment within few shots. Moreover, in order to improve the learning efficiency, we fully utilize domain knowledge for implementing a virtual player to replay the previously experienced network. Using trace-driven experiments on various scenarios including different vehicles, users, network types, and heterogeneous user-preferences, we show that BR outperforming recent ABR approaches with rapidly adapting to the personalized QoE metrics and specific network conditions. Testbed experimental results also illustrate the superiority of BR in adapting to the unseen environments.

Reinforcement Learning Based Dynamic Adaptive Video Streaming for Multi-client over NDN

Game Theory Based Dynamic Adaptive Video Streaming for Multi-Client over NDN

Dynamic Adaptive Streaming Control Based on Deep Reinforcement Learning in Named Data Networking

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

QoE-Driven Rate Adaptation Algorithm for Fair Dynamic Adaptive Video Streaming in Named Data Networking

Joint Faces Scheduling and Bitrate Switching for Dynamic Adaptive Streaming over NDN Based on Stochastic Optimization

Stochastic Adaptive Forwarding Strategy Based on Deep Reinforcement Learning for Secure Mobile Video Communications in NDN.

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

Reinforcement Learning -based Adaptation and Scheduling Methods for Multi-source DASH

PPO-ABR: Proximal Policy Optimization based Deep Reinforcement Learning for Adaptive BitRate streaming

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

Multi-User Adaptive Video Delivery over Wireless Networks: A Physical Layer Resource-Aware Deep Reinforcement Learning Approach

Adaptive Video Streaming Using Dynamic NDN Multicast in WLAN

A stochastic optimization approach for dynamic adaptive scalable video streaming over NDN

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Deep Reinforcement Learning-based Rate Adaptation for Adaptive 360-Degree Video Streaming

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

Deep Reinforcement Learning Based Adaptive 360-Degree Video Streaming with Field of View Joint Prediction

Multiuser Video Streaming Rate Adaptation: A Physical Layer Resource-Aware Deep Reinforcement Learning Approach

360HRL: Hierarchical Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming

Joint QoS Control and Bitrate Selection for Video Streaming Based on Multi-agent Reinforcement Learning