Abstract:Traditional deep neural network (DNN)-based image quality assessment (IQA) models leverage convolutional neural networks (CNN) or Transformer to learn the quality-aware feature representation, achieving commendable performance on natural scene images. However, when applied to AI-Generated images (AGIs), these DNN-based IQA models exhibit subpar performance. This situation is largely due to the semantic inaccuracies inherent in certain AGIs caused by uncontrollable nature of the generation process. Thus, the capability to discern semantic content becomes crucial for assessing the quality of AGIs. Traditional DNN-based IQA models, constrained by limited parameter complexity and training data, struggle to capture complex fine-grained semantic features, making it challenging to grasp the existence and coherence of semantic content of the entire image. To address the shortfall in semantic content perception of current IQA models, we introduce a large Multi-modality model Assisted AI-Generated Image Quality Assessment (MA-AGIQA) model, which utilizes semantically informed guidance to sense semantic information and extract semantic vectors through carefully designed text prompts. Moreover, it employs a mixture of experts (MoE) structure to dynamically integrate the semantic information with the quality-aware features extracted by traditional DNN-based IQA models. Comprehensive experiments conducted on two AI-generated content datasets, AIGCQA-20k and AGIQA-3k show that MA-AGIQA achieves state-of-the-art performance, and demonstrate its superior generalization capabilities on assessing the quality of AGIs. Code is available at <a class="link-external link-https" href="https://github.com/wangpuyi/MA-AGIQA" rel="external noopener nofollow">this https URL</a>.

SF-IQA: Quality and Similarity Integration for AI Generated Image Quality Assessment

Quality Assessment of AI-Generated Image Based on Cross-modal Correlation

AIGC Image Quality Assessment Via Image-Prompt Correspondence

A Perceptual Quality Assessment Exploration for AIGC Images

AI-generated Image Quality Assessment in Visual Communication

Biologically Inspired Image Quality Assessment

Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessment

AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondence

PrefIQA: Human Preference Learning for AI-generated Image Quality Assessment

AIGIQA-20K: A Large Database for AI-Generated Image Quality Assessment

SR-SIM: A Fast and High Performance IQA Index Based on Spectral Residual

PKU-I2IQA: An Image-to-Image Quality Assessment Database for AI Generated Images

AI-Generated Image Quality Assessment Based on Task-Specific Prompt and Multi-Granularity Similarity

AGIQA-3K: An Open Database for AI-Generated Image Quality Assessment

IE-IQA: Intelligibility Enriched Generalizable No-Reference Image Quality Assessment

Image Quality Assessment Using Spatial Frequency Component

Large Multi-modality Model Assisted AI-Generated Image Quality Assessment

Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Network

Deep Feature Compatibility for Generated Images Quality Assessment

No-Reference Image Quality Assessment Based on Dual-Domain Feature Fusion