Abstract:Internet adaptive video streaming is a typical form of video delivery that leverages adaptive bitrate (ABR) algorithms to provide video services with high quality of experience (QoE) for various users in diverse and unique network conditions. Such heterogeneous network environments, which can be viewed as exogenous input processes, often lead to the unstable performance of ABR algorithms. Unfortunately, learning-based ABR algorithm which generated by state-of-the-art reinforcement learning (RL) technologies achieves good average performance but fails to perform well in all kinds of network conditions. In this work, considering the video playback process as the Input-driven Markov Decision Process (IMDP), we propose BR (Adaptation of ABR), a novel meta-RL ABR approach. BR is mainly composed of an online stage and an offline stage. It leverages meta-RL to learn an initial meta-policy with various network conditions at the offline stage and makes decisions in personalized network conditions at the online stage. At the same time, we continually optimize the meta-policy to the tailor-made ABR policy for varying the current network environment within few shots. Moreover, in order to improve the learning efficiency, we fully utilize domain knowledge for implementing a virtual player to replay the previously experienced network. Using trace-driven experiments on various scenarios including different vehicles, users, network types, and heterogeneous user-preferences, we show that BR outperforming recent ABR approaches with rapidly adapting to the personalized QoE metrics and specific network conditions. Testbed experimental results also illustrate the superiority of BR in adapting to the unseen environments.

NEIVA: Environment Identification based Video Bitrate Adaption in Cellular Networks

Trace-Driven Optimization on Bitrate Adaptation for Mobile Video Streaming

A New Bandwidth Prediction Based Wireless Ad-Hoc Video Communication

ANT: Learning Accurate Network Throughput for Better Adaptive Video Streaming

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Improving the Performance of Online Bitrate Adaptation with Multi-Step Prediction Over Cellular Networks

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

OLNC: Online Learning of Network Conditions for Adaptive Video Streaming.

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

Two-Phase Rate Adaptation Strategy for Improving Real-Time Video QoE in Mobile Networks

Quality-Aware Neural Adaptive Video Streaming With Lifelong Imitation Learning

Predicting QoE of Video Streaming with Network-Context Features

Mobile JND: environment adapted perceptual model and mobile video quality enhancement

Adaptive QoE‐based video delivery by optimizing the bitrate of the video course using network bandwidth and user bandwidth

Improving Generalization for Neural Adaptive Video Streaming Via Meta Reinforcement Learning

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

Neural Adaptive Transport Framework for Internet-scale Interactive Media Streaming Services

EVAN: Evolutional Video Streaming Adaptation via Neural Representation

Beyond QoE: Diversity Adaptation in Video Streaming at the Edge.

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

A Neural Network Decision-Making Mechanism for Robust Video Transmission over 3g Wireless Network