Abstract:Objective video quality assessment (VQA) is the use of computational models to evaluate the video quality in line with the perception of the human visual system (HVS). It is challenging due to the underlying complexity, and the relatively limited understanding of the HVS and its intricate mechanisms. There are three important issues that arise in objective VQA in comparison with image quality assessment: 1) the temporal factors apart from the spatial ones also need to be considered, 2) the contribution of each factor (spatial and temporal) and their interaction to the overall video quality need to be determined, and 3) the computational complexity of the resultant method. In this paper, we seek to tackle the first issue by utilizing the worst case pooling strategy and the variations of spatial quality along the temporal axis with proper analysis and justification. The second issue is addressed by the use of machine learning; we believe this to be more convincing since the relationship between the factors and the overall quality is derived via training with substantial ground truth (i.e., subjective scores). Experiments conducted using publicly available video databases show the effectiveness of the proposed full-reference (FR) algorithm in comparison to the relevant existing VQA schemes. Focus has also been placed on demonstrating the robustness of the proposed method to new and untrained data. To that end, cross-database tests have been carried out to provide a proper perspective of the performance of proposed scheme as compared to other VQA methods. The third issue regarding the computational costs also plays a key role in determining the feasibility of a VQA scheme for practical deployment given the large amount of data that needs to be processed/analyzed in real time. A limitation of many existing VQA algorithms is their higher computational complexity. In contrast, the proposed scheme is more efficient due to its low complexity without jeopardizing the prediction accuracy.

Using Spatial‐Temporal Attention for Video Quality Evaluation

A Spatial-Temporal Video Quality Assessment Method via Comprehensive HVS Simulation

Video Quality Assessment: A Comprehensive Survey

A Blind Video Quality Assessment Method Via Spatiotemporal Pyramid Attention

Deep Video Quality Assessment Using Constrained Multi-Task Regression and Spatio-temporal Feature Fusion.

Efficient video quality assessment with deeper spatiotemporal feature extraction and integration

Integrates Spatiotemporal Visual Stimuli for Video Quality Assessment

End-to-End Blind Video Quality Assessment Based on Visual and Memory Attention Modeling

Low-Complexity Video Quality Assessment Using Temporal Quality Variations

Video quality assessment using temporal quality variations and machine learning

Spatiotemporal Saliency Detection based Video Quality Assessment.

Spatio-temporal salience based video quality assessment

Video Quality Assessment Based on Measuring Perceptual Noise from Spatial and Temporal Perspectives.

Quality Assessment for Video with Degradation Along Salient Trajectories

Spatial-Temporal Network for No Reference Video Quality Assessment Based on Saliency

Attention-Guided Neural Networks for Full-Reference and No-Reference Audio-Visual Quality Assessment

Video Quality Assessment Based on Swin Transformer with Spatio-Temporal Feature Fusion and Data Augmentation

Blind Consumer Video Quality Assessment with Spatial-Temporal Perception and Fusion

Video quality assessment via supervised topic model

Visual Attention Modeling for Video Quality Assessment with Structural Similarity.

Blind Video Quality Assessment Via Space-Time Slice Statistics