Abstract:Super-resolution is a promising solution to improve the quality of experience (QoE) for cloud-based video streaming when the network resources between clients and the cloud vendors become scarce. Specifically, the received video can be enhanced with a trained super-resolution model running on the client-side. However, all the existing solutions ignore the content-induced performance variability of Super-Resolution Deep Neural Network (SR-DNN) models, which means the same super-resolution models have different enhancement effects on the different parts of videos because of video content variation. That leads to unreasonable bitrate selection, resulting in low video QoE, e.g., low bitrate, rebuffering, or video quality jitters. Thus, in this paper, we propose SR-ABR, a super-resolution integrated adaptive bitrate (ABR) algorithm, which considers the content-induced performance variability of SR-DNNs into the bitrate decision process. Due to complex network conditions and video content, SR-ABR adopts deep reinforcement learning (DRL) to select future bitrate for adapting to a wide range of environments. Moreover, to utilize the content-induced performance variability of SR-DNNs efficiently, we first define the performance variability of SR-DNNs over different video content, and then use a 2D convolution kernel to distill the features of the performance variability of the SR-DNNs to a short future video segment (several chunks) as part of the inputs. We compare SR-ABR with the related state-of-the-art works using trace-driven simulation under various real-world traces. The experiments show that SR-ABR outperforms the best state-of-the-art work NAS with the gain in average QoE of 4.3%-46.2% and 18.9%-42.1% under FCC and 3G/HSDPA network traces, respectively.

FedABR: A Personalized Federated Reinforcement Learning Approach for Adaptive Video Streaming.

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

A Learning-Based Approach for Video Streaming over Fluctuating Networks with Limited Playback Buffers

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Adaptive video streaming algorithm based on meta-learning

Adaptive Video Streaming Based on Learning Intrinsic Reward

FRAS: Federated Reinforcement Learning empowered Adaptive Point Cloud Video Streaming

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Adaptive Live Streaming for Multi-user Access with Fairness Guarantee

Latency Aware Adaptive Video Streaming Using Ensemble Deep Reinforcement Learning.

A Fuzzy-Based Adaptation Controller for Low Latency Live Video Streaming

ABRF: Adaptive BitRate-FEC Joint Control for Real-Time Video Streaming

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

Survey on Reinforcement Learning Based Adaptive Bit Rate Algorithm for Mobile Video Streaming Services

Improving Generalization for Neural Adaptive Video Streaming Via Meta Reinforcement Learning

CAST: an Intricate-Scene Aware Adaptive Bitrate Approach for Video Streaming Via Parallel Training.

Queue-Learning-Based QoE Optimization for Super-Resolution-Assisted Adaptive Video Streaming.

RAV: Learning-Based Adaptive Streaming to Coordinate the Audio and Video Bitrate Selections

Buffer Awareness Neural Adaptive Video Streaming for Avoiding Extra Buffer Consumption.

SR-ABR: Super Resolution Integrated ABR Algorithm for Cloud-Based Video Streaming