Perceptual Video Quality Assessment: A Survey

Xiongkuo Min,Huiyu Duan,Wei Sun,Yucheng Zhu,Guangtao Zhai

2024-02-06

Abstract:Perceptual video quality assessment plays a vital role in the field of video processing due to the existence of quality degradations introduced in various stages of video signal acquisition, compression, transmission and display. With the advancement of internet communication and cloud service technology, video content and traffic are growing exponentially, which further emphasizes the requirement for accurate and rapid assessment of video quality. Therefore, numerous subjective and objective video quality assessment studies have been conducted over the past two decades for both generic videos and specific videos such as streaming, user-generated content (UGC), 3D, virtual and augmented reality (VR and AR), high frame rate (HFR), audio-visual, etc. This survey provides an up-to-date and comprehensive review of these video quality assessment studies. Specifically, we first review the subjective video quality assessment methodologies and databases, which are necessary for validating the performance of video quality metrics. Second, the objective video quality assessment algorithms for general purposes are surveyed and concluded according to the methodologies utilized in the quality measures. Third, we overview the objective video quality assessment measures for specific applications and emerging topics. Finally, the performances of the state-of-the-art video quality assessment measures are compared and analyzed. This survey provides a systematic overview of both classical works and recent progresses in the realm of video quality assessment, which can help other researchers quickly access the field and conduct relevant research.

Multimedia,Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

### What problem does this paper attempt to solve?

This paper primarily focuses on the research of Video Quality Assessment (VQA) and aims to provide a comprehensive and up-to-date review covering various methods and techniques of video quality assessment. Specifically, the paper attempts to address the following aspects:

1. **Importance of Video Quality**:
- Video quality assessment is crucial in the field of video processing because video signals may introduce quality degradation during acquisition, compression, transmission, and display.
- With the development of internet communication technology and cloud service technology, video content and traffic are growing exponentially, necessitating fast and accurate video quality assessment.

2. **Subjective and Objective Video Quality Assessment**:
- Subjective video quality assessment, although considered reliable and accurate, is time-consuming and costly, making it difficult to apply in practical visual communication systems.
- Objective video quality assessment aims to objectively evaluate the video quality perceived by the human visual system (HVS) through algorithms. However, video quality is affected by various factors (such as spatial and temporal resolution, frame rate, blur, noise, compression artifacts, etc.), posing challenges in designing objective assessment algorithms.

3. **Video Quality Assessment in Different Application Scenarios**:
- The paper reviews the research on quality assessment of general videos and specific applications (such as streaming media, user-generated content (UGC), virtual reality/augmented reality (VR/AR), high frame rate (HFR), audio-video, etc.).
- It studies the different perceptual characteristics of HVS for different types of videos and their impact on perceived quality.

4. **Shortcomings of Existing Reviews**:
- Most existing reviews only discuss classical VQA techniques or provide an overview of specific VQA topics without adequately covering the latest advancements in deep learning-based methods and the latest research in specific application domains.

5. **Providing a Systematic Review**:
- It provides a systematic, comprehensive, and up-to-date review covering both subjective and objective video quality assessment methods and compares and analyzes the performance of state-of-the-art video quality assessment measures.
- It helps other researchers quickly enter the field and conduct related research.

In summary, this paper aims to provide a comprehensive review of the field of video quality assessment, covering subjective assessments, objective algorithms, and the latest advancements in different application scenarios.