Abstract:With the development of social networks and intelligent terminals, it is becoming more convenient to share and acquire images. The massive growth of the number of social images makes people have higher demands for automatic image processing, especially in the aesthetic and emotional perspective. Both aesthetics assessment and emotion recognition require a higher ability for the computer to simulate high-level visual perception understanding, which belongs to the field of image processing and pattern recognition. However, existing methods often ignore the prior knowledge of images and intrinsic relationships between aesthetic and emotional perspectives. Recently, machine learning and deep learning have become powerful methods for researchers to solve mathematical problems in computing, such as image processing and pattern recognition. Both images and abstract concepts can be converted into numerical matrices and then establish the mapping relations using mathematics on computers. In this work, we propose an end-to-end multi-output deep learning model based on multimodal Graph Convolutional Network (GCN) and co-attention for aesthetic and emotion conjoint analysis. In our model, a stacked multimodal GCN network is proposed to encode the features under the guidance of the correlation matrix, and a co-attention module is designed to help the aesthetics and emotion feature representation learn from each other interactively. Experimental results indicate that our proposed model achieves competitive performance on the IAE dataset. Progressive results on the AVA and ArtPhoto datasets also prove the generalization ability of our model.

MLANs: Image Aesthetic Assessment Via Multi-Layer Aggregation Networks

Inkthetics: A Comprehensive Computational Model for Aesthetic Evaluation of Chinese Ink Paintings.

Unified Image Aesthetic Prediction via Scanpath-Guided Feature Aggregation Network.

A Small Scale Multi-Column Network For Aesthetic Classification Based On Multiple Attributes

MSCAN: Multimodal Self-and-Collaborative Attention Network for Image Aesthetic Prediction Tasks

Beyond Vision: A Multimodal Recurrent Attention Convolutional Neural Network for Unified Image Aesthetic Prediction Tasks

A multi-scene deep learning model for image aesthetic evaluation.

A Multi-level Aggregated Network for Image Restoration

Image Restoration Via Deep Memory-Based Latent Attention Network

Hybrid CNN-Transformer based Meta-Learning Approach for Personalized Image Aesthetics Assessment

Fusion Global and Local Deep Representations with Neural Attention for Aesthetic Quality Assessment

IAACS: Image Aesthetic Assessment Through Color Composition and Space Formation

Image Aesthetic Assessment Using a Saliency Symbiosis Network.

Image Aesthetic Assessment Based on Emotion-Assisted Multi-Task Learning Network

Image Aesthetic Prediction Model Based on Deep Convolutional Neural Network

A-Lamp: Adaptive Layout-Aware Multi-patch Deep Convolutional Neural Network for Photo Aesthetic Assessment

Multi-Task Convolutional Neural Network for Image Aesthetic Assessment

Multi-Output Learning Based on Multimodal GCN and Co-Attention for Image Aesthetics and Emotion Analysis

Modeling Human Perception For Image Aesthetic Assessment\

Style-adaptive Photo Aesthetic Rating Via Convolutional Neural Networks and Multi-Task Learning

MLAN: Multi-Level Attention Network