Abstract:Recently, many models have been developed to predict video Quality of Experience (QoE), yet the applicability of these models still faces significant challenges. Firstly, many models rely on features that are unique to a specific dataset and thus lack the capability to generalize. Due to the intricate interactions among these features, a unified representation that is independent of datasets with different modalities is needed. Secondly, existing models often lack the configurability to perform both classification and regression tasks. Thirdly, the sample size of the available datasets to develop these models is often very small, and the impact of limited data on the performance of QoE models has not been adequately addressed. To address these issues, in this work we develop a novel and end-to-end framework termed as DeepQoE. The proposed framework first uses a combination of deep learning techniques, such as word embedding and 3D convolutional neural network (C3D), to extract generalized features. Next, these features are combined and fed into a neural network for representation learning. A learned representation will then serve as input for classification or regression tasks. We evaluate the performance of DeepQoE with three datasets. The results show that for small datasets (e.g., WHU-MVQoE2016 and Live-Netflix Video Database), the performance of state-of-the-art machine learning algorithms is greatly improved by using the QoE representation from DeepQoE (e.g., 35.71% to 44.82%); while for the large dataset (e.g., VideoSet), our DeepQoE framework achieves significant performance improvement in comparison to the best baseline method (90.94% vs. 82.84%). In addition to the much improved performance, DeepQoE has the flexibility to fit different datasets, to learn QoE representation, and to perform both classification and regression problems. We also develop a DeepQoE based adaptive bitrate streaming (ABR) system to verify that our framework can be easily applied to multimedia communication service. The software package of the DeepQoE framework has been released to facilitate the current research on QoE.

PsyQoE: Improving Quality-of-Experience Assessment with Psychological Effects in Video Streaming

From QoS to QoE: A Tutorial on Video Quality Assessment.

Event-Based Perceptual Quality Assessment for HTTP-Based Video Streaming with Playback Interruption.

QoE in Video Transmission: A User Experience-Driven Strategy

A Prospect of Interdisciplinary Methodology of QoE Assessment.

Adaptive Video Streaming with Automatic Quality-of-Experience Optimization

QoE Models for Online Video Streaming

QOE Evaluation of Video Services Considering Users' Behavior.

QoE‐aware traffic monitoring based on user behavior in video streaming services

Subjective and Objective Quality-of-Experience Evaluation Study for Live Video Streaming

QoE Evaluation of Multimedia Services Based on Audiovisual Quality and User Interest.

Enhancing User Experience in Ultra HD Cloud Performing Arts Live Streaming: A QoS-to-QoE Mapping Approach

Quality of Experience Evaluation for Networked Video Services

QoE Evaluation Model of Mobile Streaming Media

DeepQoE: A Multimodal Learning Framework for Video Quality of Experience (qoe) Prediction.

A method of QoE evaluation for adaptive streaming based on bitrate distribution

A Software Platform Design for Objective Video QoE Assessment.

A unified QoE prediction framework for HEVC encoded video streaming over wireless networks

QoECenter: A Visual Platform for QoE Evaluation of Streaming Video Services

A QoE Model in Point Cloud Video Streaming

QoE-oriented resource management strategy by considering user preference for video content