AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondence

Jiarui Wang,Huiyu Duan,Jing Liu,Shi Chen,Xiongkuo Min,Guangtao Zhai

2023-07-15

Abstract:In this paper, in order to get a better understanding of the human visual preferences for AIGIs, a large-scale IQA database for AIGC is established, which is named as AIGCIQA2023. We first generate over 2000 images based on 6 state-of-the-art text-to-image generation models using 100 prompts. Based on these images, a well-organized subjective experiment is conducted to assess the human visual preferences for each image from three perspectives including quality, authenticity and correspondence. Finally, based on this large-scale database, we conduct a benchmark experiment to evaluate the performance of several state-of-the-art IQA metrics on our constructed database.

Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

The paper aims to address the quality issues faced by AI-generated images (AIGI) in practical applications. Specifically, due to some unique distortions that AIGI may have, these images often cannot be directly used in real-world scenarios and require further processing or filtering. Therefore, it becomes particularly important to study human visual preferences for AIGI and design corresponding objective image quality assessment (IQA) metrics.

To better understand human visual preferences for AIGI, the paper establishes a large-scale IQA database named AIGCIQA2023. This database contains 2400 images generated by 6 state-of-the-art text-to-image generation models based on 100 different text prompts. Based on these images, the researchers conducted a systematic subjective experiment to evaluate each image from three perspectives: quality, realism, and correspondence to the text prompt. Additionally, based on the constructed database, the researchers also evaluated the performance of various current state-of-the-art IQA algorithms and established a new benchmark.

The experimental results show that existing IQA methods are inadequate in assessing the quality of AIGI, particularly in evaluating the correspondence between text and image. This indicates that more efforts are needed in the future to improve research in this area. In summary, the main contribution of the paper is to propose measuring human visual experience of AIGI from three aspects: quality, realism, and text-image correspondence, and to support this theory through a large-scale database and benchmark testing.