Abstract:Recently, with the growing popularity of mobile devices as well as video sharing platforms (e.g., YouTube, Facebook, TikTok, and Twitch), User-Generated Content (UGC) videos have become increasingly common and now account for a large portion of multimedia traffic on the internet. Unlike professionally generated videos produced by filmmakers and videographers, typically, UGC videos contain multiple authentic distortions, generally introduced during capture and processing by naive users. Quality prediction of UGC videos is of paramount importance to optimize and monitor their processing in hosting platforms, such as their coding, transcoding, and streaming. However, blind quality prediction of UGC is quite challenging because the degradations of UGC videos are unknown and very diverse, in addition to the unavailability of pristine reference. Therefore, in this paper, we propose an accurate and efficient Blind Video Quality Assessment (BVQA) model for UGC videos, which we name 2BiVQA for double Bi-LSTM Video Quality Assessment. 2BiVQA metric consists of three main blocks, including a pre-trained Convolutional Neural Network (CNN) to extract discriminative features from image patches, which are then fed into two Recurrent Neural Networks (RNNs) for spatial and temporal pooling. Specifically, we use two Bi-directional Long Short Term Memory (Bi-LSTM) networks, the first is used to capture short-range dependencies between image patches, while the second allows capturing longrange dependencies between frames to account for the temporal memory effect. Experimental results on recent large-scale UGC VQA datasets show that 2BiVQA achieves high performance at lower computational cost than most state-of-the-art VQA models. The source code of our 2BiVQA metric is made publicly available at: <a class="link-external link-https" href="https://github.com/atelili/2BiVQA" rel="external noopener nofollow">this https URL</a>

Evaluation on Huawei Accurate and Fast Mobile Video Annotation Challenge

Challenge Huawei challenge: Fusing multimodal features with deep neural networks for Mobile Video Annotation

AIS 2024 Challenge on Video Quality Assessment of User-Generated Content: Methods and Results

MEGC2020 - the Third Facial Micro-Expression Grand Challenge

User-generated Video Quality Assessment: A Subjective and Objective Study

An Intelligent Video Tag Recommendation Method for Improving Video Popularity in Mobile Computing Environment

MEGC2023: ACM Multimedia 2023 ME Grand Challenge

Video Quality Assessment: A Comprehensive Survey

UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content

NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Results

MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videos

Video Transformer based Video Quality Assessment with Spatiotemporally adaptive Token Selection and Assembly

XGC-VQA: A unified video quality assessment model for User, Professionally, and Occupationally-Generated Content

Crowdsourcing System for Multi-object Annotation in Surveillance Videos

Optimizing Cloud-Based Video Crowdsensing.

PUGCQ: A Large Scale Dataset for Quality Assessment of Professional User-Generated Content

Msr asia msm at activitynet challenge 2016

Unified Quality Assessment of in-the-Wild Videos with Mixed Datasets Training

MoVieUp: Automatic Mobile Video Mashup

2BiVQA: Double Bi-LSTM based Video Quality Assessment of UGC Videos

Content-based Video Relevance Prediction Challenge: Data, Protocol, and Baseline