Abstract:Facing the ever-increasing demand for high quality video streaming and the dramatic variations of wireless network environment, adaptive bitrate video streaming (ABS) emerges as a prominent video quality adaptation technique in improving users’ quality of experience (QoE). Reinforcement learning (RL)-based ABS and network-assisted ABS can improve users’ QoE through resource utilization efficiency enhancement. However, limited network capacity is still the bottleneck of QoE improvement. Considering the potential capacity gain of non-orthogonal multiple access (NOMA), we study network-assisted ABS in NOMA networks. Based on a synchronous video streaming model and the knowledge of channel state information for next segment, a joint optimization problem of resource allocation and bitrate adaptation is formulated to maximize users’ QoE and minimize energy consumption. The original problem is NP-hard and intractable due to the interference coordination problem introduced by NOMA and the multi-slot sum rate constraint. We decompose the original problem into the subproblem of joint subchannel assignment and power allocation (JSAPA), and the subproblem of bitrate adaptation (BA) with Lagrange relaxation method. A joint resource allocation and bitrate adaptation (JRABA) algorithm is further proposed to solve the JSAPA and BA subproblems iteratively. Specifically, the JSAPA subproblem is solved by an extended Gale-Shapley matching algorithm and differ of convex (DC) programming method iteratively. For the BA subproblem, appropriate video bitrate is explored with subgradient method. Numerical results validate the effectiveness of the proposed algorithm and reveal that network-assisted ABS in NOMA networks benefits users in achieving higher QoE with less energy consumption, especially when radio resources are insufficient or with large segment size.

Neural Adaptive Video Streaming with OfflineReinforcement Learning

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

Improving Generalization for Neural Adaptive Video Streaming Via Meta Reinforcement Learning

Adaptive Video Streaming Based on Learning Intrinsic Reward

OLNC: Online Learning of Network Conditions for Adaptive Video Streaming.

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

Adaptive video streaming algorithm based on meta-learning

Enhancing Neural Adaptive Wireless Video Streaming via Lower-Layer Information Exposure and Online Tuning

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Adaptive Bitrate Video Streaming in Non-orthogonal Multiple Access Networks

Latency Aware Adaptive Video Streaming Using Ensemble Deep Reinforcement Learning.

A Learning-Based Approach for Video Streaming over Fluctuating Networks with Limited Playback Buffers

Imitation Learning for Adaptive Video Streaming with Future Adversarial Information Bottleneck Principle

OnRL: Improving Mobile Video Telephony via Online Reinforcement Learning

Survey on Reinforcement Learning Based Adaptive Bit Rate Algorithm for Mobile Video Streaming Services

AraLive: Automatic Reward Adaption for Learning-based Live Video Streaming

RAV: Learning-Based Adaptive Streaming to Coordinate the Audio and Video Bitrate Selections

FedABR: A Personalized Federated Reinforcement Learning Approach for Adaptive Video Streaming.

PPO-ABR: Proximal Policy Optimization based Deep Reinforcement Learning for Adaptive BitRate streaming

Adaptive Bitrate Streaming in Wireless Networks With Transcoding at Network Edge Using Deep Reinforcement Learning