Abstract:The diversity of video delivery pipeline poses a grand challenge to the evaluation of adaptive bitrate (ABR) streaming algorithms and objective quality-of-experience (QoE) models. Here we introduce so-far the largest subject-rated database of its kind, namely WaterlooSQoE-IV, consisting of 1350 adaptive streaming videos created from diverse source contents, video encoders, network traces, ABR algorithms, and viewing devices. We collect human opinions for each video with a series of carefully designed subjective experiments. Subsequent data analysis and testing/comparison of ABR algorithms and QoE models using the database lead to a series of novel observations and interesting findings, in terms of the effectiveness of subjective experiment methodologies, the interactions between user experience and source content, viewing device and encoder type, the heterogeneities in the bias and preference of user experiences, the behaviors of ABR algorithms, and the performance of objective QoE models. Most importantly, our results suggest that a better objective QoE model, or a better understanding of human perceptual experience and behaviour, is the most dominating factor in improving the performance of ABR algorithms, as opposed to advanced optimization frameworks, machine learning strategies or bandwidth predictors, where a majority of ABR research has been focused on in the past decade. On the other hand, our performance evaluation of 11 QoE models shows only a moderate correlation between state-of-the-art QoE models and subjective ratings, implying rooms for improvement in both QoE modeling and ABR algorithms. The database is made publicly available at: \url{<a class="link-external link-https" href="https://ece.uwaterloo.ca/~zduanmu/waterloosqoe4/" rel="external noopener nofollow">this https URL</a>}.

Survey on Reinforcement Learning Based Adaptive Bit Rate Algorithm for Mobile Video Streaming Services

Deep-Reinforcement-Learning-based User-Preference-Aware Rate Adaptation for Video Streaming

MetaABR: A Meta-Learning Approach on Adaptative Bitrate Selection for Video Streaming

Learning Tailored Adaptive Bitrate Algorithms to Heterogeneous Network Conditions: A Domain-Specific Priors and Meta-Reinforcement Learning Approach

Learning Accurate Network Dynamics for Enhanced Adaptive Video Streaming

Joint QoS Control and Bitrate Selection for Video Streaming Based on Multi-agent Reinforcement Learning

FedABR: A Personalized Federated Reinforcement Learning Approach for Adaptive Video Streaming.

A Brief Survey on Adaptive Video Streaming Quality Assessment

Adaptive Resource Allocation for DASH-based Video Streaming in Mobile Networks

Tiyuntsong: A Self-Play Reinforcement Learning Approach for ABR Video Streaming

Modeling and Analyzing Live Streaming Performance.

Assessing the Quality-of-Experience of Adaptive Bitrate Video Streaming

Sequential Reinforced 360-Degree Video Adaptive Streaming with Cross-user Attentive Network

DRL Empowered On-policy and Off-policy ABR for 5G Mobile Ultra-HD Video Delivery

QoE-Oriented Rate Adaptation for DASH with Enhanced Deep Q-Learning

Improving Quality of Experience by Adaptive Video Streaming with Super-Resolution

PPO-ABR: Proximal Policy Optimization based Deep Reinforcement Learning for Adaptive BitRate streaming

Trace-Driven Optimization on Bitrate Adaptation for Mobile Video Streaming

Hybrid Control-Based ABR: Towards Low-Delay Live Streaming

LL-GABR: Energy Efficient Live Video Streaming Using Reinforcement Learning

Federated Deep Reinforcement Learning-based Bitrate Adaptation for Dynamic Adaptive Streaming over HTTP