AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Images

Liu Yang,Huiyu Duan,Long Teng,Yucheng Zhu,Xiaohong Liu,Menghan Hu,Xiongkuo Min,Guangtao Zhai,Patrick Le Callet

2024-04-01

Abstract:In recent years, the rapid advancement of Artificial Intelligence Generated Content (AIGC) has attracted widespread attention. Among the AIGC, AI generated omnidirectional images hold significant potential for Virtual Reality (VR) and Augmented Reality (AR) applications, hence omnidirectional AIGC techniques have also been widely studied. AI-generated omnidirectional images exhibit unique distortions compared to natural omnidirectional images, however, there is no dedicated Image Quality Assessment (IQA) criteria for assessing them. This study addresses this gap by establishing a large-scale AI generated omnidirectional image IQA database named AIGCOIQA2024 and constructing a comprehensive benchmark. We first generate 300 omnidirectional images based on 5 AIGC models utilizing 25 text prompts. A subjective IQA experiment is conducted subsequently to assess human visual preferences from three perspectives including quality, comfortability, and correspondence. Finally, we conduct a benchmark experiment to evaluate the performance of state-of-the-art IQA models on our database. The database will be released to facilitate future research.

Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

This paper focuses on the quality evaluation of AI-generated panoramic images (360-degree images). Currently, although AI-generated content has developed rapidly in various forms such as text, images, music, and videos, there is no dedicated quality evaluation standard for AI-generated panoramic images. These images are commonly used in virtual reality (VR) and augmented reality (AR) applications, but they may have issues such as blurriness, noise, distortion, lighting problems, as well as quality issues specific to AI generation, such as unrealism, unreasonable composition, and poor correspondence between text and images.

To address this issue, researchers have established a large-scale AI-generated panoramic image quality evaluation database called AIGCOIQA2024 and constructed a comprehensive benchmark test. They first generated 300 panoramic images based on 5 different AI generation models and 25 textual prompts describing different indoor and outdoor scenes. Then, subjective quality evaluation experiments were conducted to collect human visual preference scores from the aspects of quality, comfort, and correspondence.

The experimental results show that existing image quality evaluation models mainly focus on low-level visual quality aspects, while AI-generated panoramic images may also have problems in higher-level preferences. Therefore, the paper proposes evaluating the human visual preference of AI-generated panoramic images from three dimensions: quality, comfort, and correspondence.

In addition, the researchers conducted a benchmark test to assess the performance of some state-of-the-art quality evaluation models on the new database. The results indicate that current models do not perform well in this new task, and future research can explore the characteristics of natural panoramic images to improve comfort evaluation and utilize text information to enhance correspondence evaluation.