Abstract:The spread of social networking services has created an increasing demand for selecting, editing, and generating impressive images. This trend increases the importance of evaluating image aesthetics as a complementary function of automatic image processing. We propose a multi-patch method, named MPA-Net (Multi-Patch Aggregation Network), to predict image aesthetics scores by maintaining the original aspect ratios of contents in the images. Through an experiment involving the large-scale AVA dataset, which contains 250,000 images, we show that the effectiveness of the equal-interval multi-patch selection approach for aesthetics score prediction is significant compared to the single-patch prediction and random patch selection approaches. For this dataset, MPA-Net outperforms the neural image assessment algorithm, which was regarded as a baseline method. In particular, MPA-Net yields a 0.073 (11.5%) higher linear correlation coefficient (LCC) of aesthetics scores and a 0.088 (14.4%) higher Spearman's rank correlation coefficient (SRCC). MPA-Net also reduces the mean square error (MSE) by 0.0115 (4.18%) and achieves results for the LCC and SRCC that are comparable to those of the state-of-the-art continuous aesthetics score prediction methods. Most notably, MPA-Net yields a significant lower MSE especially for images with aspect ratios far from 1.0, indicating that MPA-Net is useful for a wide range of image aspect ratios. MPA-Net uses only images and does not require external information during the training nor prediction stages. Therefore, MPA-Net has great potential for applications aside from aesthetics score prediction such as other human subjectivity prediction.

M+Mnet: A Multibranch Network with Mixed Precision Training for Image Aesthetics Assessment

Improving Image Aesthetic Assessment via Multiple Image Joint Learning

MMMNet: An End-to-End Multi-Task Deep Convolution Neural Network With Multi-Scale and Multi-Hierarchy Fusion for Blind Image Quality Assessment

Image Aesthetics Assessment With Attribute-Assisted Multimodal Memory Network

A Multibranch Network With Multilayer Feature Fusion for No-Reference Image Quality Assessment

Attribute-assisted Multimodal Network for Image Aesthetics Assessment.

Image Aesthetics Prediction Using Multiple Patches Preserving the Original Aspect Ratio of Contents

MetaMP: Metalearning-Based Multipatch Image Aesthetics Assessment.

MBIAN: Multi-level Bilateral Interactive Attention Network for Multi-Modal Image Processing

Multi-Modality Multi-Attribute Contrastive Pre-Training for Image Aesthetics Computing

MSCAN: Multimodal Self-and-Collaborative Attention Network for Image Aesthetic Prediction Tasks

Confidence-Based Dynamic Cross-Modal Memory Network for Image Aesthetic Assessment

ABSNet: Aesthetics-Based Saliency Network Using Multi-Task Convolutional Network

BMI-Net: A Brain-inspired Multimodal Interaction Network for Image Aesthetic Assessment

Aesthetic Attribute Assessment of Images Numerically on Mixed Multi-attribute Datasets

MSAFF-Net: Multiscale Attention Feature Fusion Networks for Single Image Dehazing and Beyond

AesMamba: Universal Image Aesthetic Assessment with State Space Models

MIPANet: optimizing RGB-D semantic segmentation through multi-modal interaction and pooling attention

Hybrid CNN-Transformer based Meta-Learning Approach for Personalized Image Aesthetics Assessment

MBSI-Net: Multimodal Balanced Self-Learning Interaction Network for Image Classification

MSA-Net: Multiscale Spatial Attention Network for the Classification of Breast Histology Images