Abstract:With the popularity of handheld devices, the development of wireless communication technology and the proliferation of multimedia resources, mobile video has become the main business in LTE networks with explosive traffic demands. How to improve the quality of experience (QoE) of mobile video in the dynamic and complex network environment has become a research focus. Dynamic adaptive streaming over HTTP technology introduces adaptive bitrate (ABR) requests at the client side to improve video QoE and various rate adaptation algorithms are also constantly proposed. In view of the limitations of the existing heuristic or learning-based ABR methods, we propose redirecting enhanced Deep Q-learning toward DASH video QoE (RDQ), a QoE-oriented rate adaptation framework based on enhanced deep Q-learning. First, we establish a chunkwise subjective QoE model and utilize it as the reward function in reinforcement learning so that the strategy can converge toward the direction of maximizing the subjective QoE score. Then, we apply several effective improvements of deep Q-learning to the RDQ agent’s neural network architecture and learning mechanism to achieve faster convergence and higher average reward than other learning-based methods. The proposed RDQ agent has been thoroughly evaluated using trace-based simulation on the real-time LTE network data. For disparate network scenarios and different video contents, the RDQ agent can outperform the existing methods in terms of the QoE score. The breakdown analysis shows that RDQ can suppress the number and the duration of the stalling events to the minimum while maintaining high video bitrate, thus achieving better QoE performance than other methods.

Adaptive Streaming Algorithm Based on Reinforcement Learning

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

Reinforcement Learning -based Adaptation and Scheduling Methods for Multi-source DASH

Deep Reinforcement Learning-based Rate Adaptation for Adaptive 360-Degree Video Streaming

An Adaptative Bitrate Algorithm for DASH

Adaptive Resource Allocation for DASH-based Video Streaming in Mobile Networks

QoE-Oriented Rate Adaptation for DASH with Enhanced Deep Q-Learning

Preference-Aware Dynamic Bitrate Adaptation for Mobile Short-Form Video Feed Streaming

Mdash: A Markov Decision-Based Rate Adaptation Approach for Dynamic HTTP Streaming

DRL360: 360-Degree Video Streaming with Deep Reinforcement Learning

Improving Quality of Experience by Adaptive Video Streaming with Super-Resolution

LEAP: Learning-Based Smart Edge with Caching and Prefetching for Adaptive Video Streaming

AP-assisted adaptive video streaming in wireless networks with high-density clients

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP

A Brief Survey on Adaptive Video Streaming Quality Assessment

Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming

A Fairness-Aware Smooth Rate Adaptation Approach for Dynamic Http Streaming

Improving Robustness of DASH Against Unpredictable Network Variations

A Quality-driven Bit Rate Adaptation Method for Dynamic Adaptive Streaming over HTTP

Enhancement or Super-Resolution: Learning-based Adaptive Video Streaming with Client-Side Video Processing

Optimized bitrate ladders for adaptive video streaming with deep reinforcement learning