Abstract:Quantifications of image quality and aesthetic have been regarded as two independent fields in computer vision. Generally, image quality assessment aims at measuring image distortions and image aesthetic is judged by commonly established photography rules. However, either measuring image quality or aesthetic alone is not sufficient to qualitatively rank images. Therefore, this paper puts forward the synergetic assessment of quality and aesthetic to help understand the subjective human preferences of digital pictures more comprehensively. Specifically, considering that the images of existing benchmark datasets are only labeled with single attribute, we first establish a new dataset which contains 9042 real-world images with the corresponding human rated pair-wise quality-aesthetic scores. Previously, these images are only labeled with aesthetic score, and we evaluate the subjective quality score of them, so that it can make up the lack of image dataset with double attributes. Moreover, since the existing methods are mostly designed for individual attribute prediction. We then propose a two-stream learning network to assess both quality and aesthetic of images in parallel. This network follows the top-down perception mechanism which learns from both fined grained details and holistic image layout simultaneously. Furthermore, we introduce a Channel-Diversity loss, which can be deployed in grouped convolution operation, and can constrain channels to be mutually exclusive across the spatial dimensions. To some extent, this contributes to spotlight different local discriminative regions with a finer granularity. Finally, experiments demonstrate that our method outperforms the state-of-the-art methods on our established benchmark dataset and other benchmark datasets in terms of image quality and aesthetic assessment. We hope this paper could serve as a potent reference and be useful for future research on the study of image ranking. Both the benchmark dataset and the code will be publicly available to facilitate further research.

Personalized Image Quality Assessment with Social-Sensed Aesthetic Preference

Personalized Image Aesthetic Assessment based on Graph Neural Network and Collaborative Filtering

Collaborative and Attentive Learning for Personalized Image Aesthetic Assessment

Learning Personalized Image Aesthetics from Subjective and Objective Attributes

Self-Adaptive Computational Aesthetic Evaluation of Chinese Ink Paintings Based on Deep Learning

USAR: an Interactive User-specific Aesthetic Ranking Framework for Images

Image Aesthetics Assessment Based on User Social Behavior.

Personalized Image Aesthetics Assessment Via Multi-Attribute Interactive Reasoning

Inkthetics: A Comprehensive Computational Model for Aesthetic Evaluation of Chinese Ink Paintings.

Joint regression and learning from pairwise rankings for personalized image aesthetic assessment

Personalized Image Aesthetics Assessment with Attribute-guided Fine-grained Feature Representation

User-Guided Personalized Image Aesthetic Assessment based on Deep Reinforcement Learning

Personality-assisted Multi-task Learning for Generic and Personalized Image Aesthetics Assessment.

Imaginique Expressions: Tailoring Personalized Short-Text-to-Image Generation Through Aesthetic Assessment and Human Insights

Towards Personalized Aesthetic Image Caption

Query-Dependent Aesthetic Model with Deep Learning for Photo Quality Assessment

Aesthetic Features for Personalized Photo Recommendation

Will People Like Your Image? Learning the Aesthetic Space

Synergetic Assessment of Quality and Aesthetic: Approach and Comprehensive Benchmark Dataset

Scaling Up Personalized Image Aesthetic Assessment via Task Vector Customization

Personality Driven Multi-task Learning for Image Aesthetic Assessment