Abstract:Many popular video quality assessment (VQA) methods usually build models by simulating the process of human visual perception and adopt a simple regression strategy to predict video quality scores. However, these methods either hardly pay enough attention to regression processing prone to misprediction, or fail to accurately understand video content containing changes of movement or sudden movements. To remedy these, we propose a full reference (FR) video quality assessment model that integrates multi-task learning regression and analysis of spatio-temporal features to conduct video quality predictions. Firstly, the model arranges each frame of the reference and distorted videos into patches and calculates their entropy values to guide the selection of frame patches. A 2D Siamese network is then applied on the selected patches to learn spatial information. To more effectively capture temporal distortions, a multi-frame difference map is computed on each distorted video. The computed multi-frame difference maps are also partitioned into patches to select half of the ones with highest entropy values as temporal features. Additionally, we incorporate the temporal masking effect to optimize the spatial error and temporal features and adopt 3D convolutional neural network (CNN) in spatio-temporal feature fusion. Following recent evidence towards quality classification and quality regression, a constrained multi-task learning regression model is designed to aggregate the quality score, using quality classification subtask to contrain and optimize quality regression main task. Finally, the video quality score is predicted through the regression branch. We have evaluated our algorithm on five public VQA databases. The experimental results have revealed that the proposed algorithm can achieve superior performance as compared with the existing VQA methods.

Video Quality Assessment Using Neural Network Based On Multifeature Extraction

Video Quality Assessment Using Radial Basis Function Neural Network

Human Visual Perception Based Image Quality Assessment for Video Prediction

Objective Quality Assessment of Retargeted Images Based on RBF Neural Network with Structural Distortion and Content Change

Image and Video Quality Assessment Using Neural Network and SVM

Quality Assessment for Networked Video Streaming Based on Deep Learning.

Quality assessment for MPEG-2 video streams using a neural network model

No-reference video quality assessment for MPEG-2 video streams using BP neural networks

Deep Video Quality Assessment Using Constrained Multi-Task Regression and Spatio-temporal Feature Fusion.

No-reference Video Quality Assessment Based on Perceptual Features Extracted from Multi-Directional Video Spatiotemporal Slices Images

Multi-Dimensional Feature Fusion Network for No-Reference Quality Assessment of In-the-Wild Videos.

User-generated Video Quality Assessment: A Subjective and Objective Study

Video Quality Assessment Based on Measuring Perceptual Noise from Spatial and Temporal Perspectives.

Reduced-reference video QoE assessment method based on image feature information

Bayesian Network-Based Video QoE Assessment Method Using Image Sustained Damage Analysis

Deep Blind Video Quality Assessment for User Generated Videos.

A Content-Oriented No-Reference Perceptual Video Quality Assessment Method for Computer Graphics Animation Videos

IPTV Video Quality Assessment Model Based on Neural Network.

No-Reference Perceptual Video Quality Measurement for High Definition Videos Based on an Artificial Neural Network

Image Quality Assessment for Video Surveillance System.

An End-to-End No-Reference Video Quality Assessment Method with Hierarchical Spatiotemporal Feature Representation