Abstract:In recent years, User Generated Content (UGC) has grown dramatically in video sharing applications. It is necessary for service-providers to use video quality assessment (VQA) to monitor and control users' Quality of Experience when watching UGC videos. However, most existing UGC VQA studies only focus on the visual distortions of videos, ignoring that the perceptual quality also depends on the accompanying audio signals. In this paper, we conduct a comprehensive study on UGC audio-visual quality assessment (AVQA) from both subjective and objective perspectives. Specially, we construct the first UGC AVQA database named SJTU-UAV database, which includes 520 in-the-wild UGC audio and video (A/V) sequences collected from the YFCC100m database. A subjective AVQA experiment is conducted on the database to obtain the mean opinion scores (MOSs) of the A/V sequences. To demonstrate the content diversity of the SJTU-UAV database, we give a detailed analysis of the SJTU-UAV database as well as other two synthetically-distorted AVQA databases and one authentically-distorted VQA database, from both the audio and video aspects. Then, to facilitate the development of AVQA fields, we construct a benchmark of AVQA models on the proposed SJTU-UAV database and other two AVQA databases, of which the benchmark models consist of AVQA models designed for synthetically distorted A/V sequences and AVQA models built through combining the popular VQA methods and audio features via support vector regressor (SVR). Finally, considering benchmark AVQA models perform poorly in assessing in-the-wild UGC videos, we further propose an effective AVQA model via jointly learning quality-aware audio and visual feature representations in the temporal domain, which is seldom investigated by existing AVQA models. Our proposed model outperforms the aforementioned benchmark AVQA models on the SJTU-UAV database and two synthetically distorted AVQA databases. The SJTU-UAV database and the c- de of the proposed model will be released to facilitate further research.

UGC-VIDEO: Perceptual Quality Assessment of User-Generated Videos

User-generated Video Quality Assessment: A Subjective and Objective Study

From QoS to QoE: A Tutorial on Video Quality Assessment.

Subjective and Objective Quality Evaluation of UGC Video after Encoding and Decoding

BVI-UGC: A Video Quality Database for User-Generated Content Transcoding

On Quality Control of User-Generated-content (UGC) Compression

PUGCQ: A Large Scale Dataset for Quality Assessment of Professional User-Generated Content

MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videos

Audio-Visual Quality Assessment for User Generated Content: Database and Method

Full-reference Video Quality Assessment for User Generated Content Transcoding

Subjective and Objective Audio-Visual Quality Assessment for User Generated Content

Perceptual Video Quality Assessment: A Survey

UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content

Perceptual Quality Assessment of Internet Videos.

FineVQ: Fine-Grained User Generated Content Video Quality Assessment

Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives

XGC-VQA: A unified video quality assessment model for User, Professionally, and Occupationally-Generated Content

Full-Reference And No-Reference Quality Assessment For Compressed User-Generated Content Videos

Quality Assessment of UGC Videos Based on Decomposition and Recomposition

Subjective and Objective Analysis of Streamed Gaming Videos