Abstract:With the increasing prevalence of smartphones and websites, Image Aesthetic Assessment (IAA) has become increasingly crucial. While the significance of attributes in IAA is widely recognized, many attribute-based methods lack consideration for the selection and utilization of aesthetic attributes. Our initial step involves the acquisition of aesthetic attributes from both intra- and inter-perspectives. Within the intra-perspective, we extract the direct visual attributes of images, constituting the absolute attribute. In the inter-perspective, our focus lies in modeling the relative score relationships between images within the same sequence, forming the relative attribute. Then, to better utilize image attributes in aesthetic assessment, we propose the Unified Multi-attribute Aesthetic Assessment Framework (UMAAF) to model both absolute and relative attributes of images. For absolute attributes, we leverage multiple absolute-attribute perception modules and an absolute-attribute interacting network. The absolute-attribute perception modules are first pre-trained on several absolute-attribute learning tasks and then used to extract corresponding absolute attribute features. The absolute-attribute interacting network adaptively learns the weight of diverse absolute-attribute features, effectively integrating them with generic aesthetic features from various absolute-attribute perspectives and generating the aesthetic prediction. To model the relative attribute of images, we consider the relative ranking and relative distance relationships between images in a Relative-Relation Loss function, which boosts the robustness of the UMAAF. Furthermore, UMAAF achieves state-of-the-art performance on TAD66K and AVA datasets, and multiple experiments demonstrate the effectiveness of each module and the model's alignment with human preference.

Improving Image Aesthetic Assessment via Multiple Image Joint Learning

Image Aesthetics Assessment With Attribute-Assisted Multimodal Memory Network

Attribute-assisted Multimodal Network for Image Aesthetics Assessment.

Emotion-aware Hierarchical Interaction Network for Multimodal Image Aesthetics Assessment

BMI-Net: A Brain-inspired Multimodal Interaction Network for Image Aesthetic Assessment

Advancing Comprehensive Aesthetic Insight with Multi-Scale Text-Guided Self-Supervised Learning

M+Mnet: A Multibranch Network with Mixed Precision Training for Image Aesthetics Assessment

Semantic and style based multiple reference learning for artistic and general image aesthetic assessment

UNIAA: A Unified Multi-modal Image Aesthetic Assessment Baseline and Benchmark

Confidence-Based Dynamic Cross-Modal Memory Network for Image Aesthetic Assessment

IAACS: Image Aesthetic Assessment Through Color Composition and Space Formation

Image Aesthetics Assessment With Emotion-Aware Multibranch Network

AesMamba: Universal Image Aesthetic Assessment with State Space Models

MetaMP: Metalearning-Based Multipatch Image Aesthetics Assessment.

Context-aware Attention Network for Predicting Image Aesthetic Subjectivity

Coarse-to-fine Image Aesthetics Assessment with Dynamic Attribute Selection

Image Aesthetics Prediction Using Multiple Patches Preserving the Original Aspect Ratio of Contents

Aesthetic Attribute Assessment of Images Numerically on Mixed Multi-attribute Datasets

Collaborative and Attentive Learning for Personalized Image Aesthetic Assessment

UMAAF: Unveiling Aesthetics via Multifarious Attributes of Images

Thinking Image Color Aesthetics Assessment: Models, Datasets and Benchmarks