Abstract:Computational aesthetic evaluation of artworks has become an active research direction in recent years. However, current works mainly focus on oil paintings and photographs, there have been few attempts in quantitative aesthetic evaluation of Chinese ink paintings. Chinese ink painting uses ink blended with water and a variation of brushwork to depict picture, which differs significantly from photographs and oil paintings in visual features, semantic features, and aesthetic principles. Aiming at this problem, we propose a framework of self-adaptive computational aesthetic evaluation of Chinese ink paintings based on deep learning technique. Firstly, we build an aesthetic evaluation standard dataset for ink painting images. Secondly, according to aesthetic principles of Chinese ink paintings, we design a multi-view parallel deep neural network by taking global images and local patches as multi-column inputs to extract deep aesthetic features. Finally, we build a self-adaptive deep aesthetic model of Chinese ink paintings based on subject query mechanism. Experimental results show that, compared with the basic VGG16 architecture, our multi-view network that contains six paralleled subject convolution groups has higher aesthetic evaluation performance, the deep aesthetic features outperform the traditional hand-crafted features, and our proposed self-adaptive model can predict human aesthetic decision with highly significant Pearson correlation of 0.823, with mean squared error of 0.161. Moreover, interference experiments show that our network is sensitive to painting factors including composition, ink color, and texture. Our work not only offers a deeply-learned-based reference framework for quantitative aesthetic evaluation of Chinese paintings, but also reveals the relationship between human aesthetic perceptions and deeply-learned features extracted from Chinese ink paintings.

Application of Deep Convolutional Features in Sketch Works Classification and Evaluation

Sketch-R2CNN: an Attentive Network for Vector Sketch Recognition

<i>Sketch-R2CNN</i>: An RNN-Rasterization-CNN Architecture for Vector Sketch Recognition

Sketchformer++: A Hierarchical Transformer Architecture for Vector Sketch Representation

Research on Image Classification Method of Features of Combinatorial Convolution

Mural Sketch Generation via Style-aware Convolutional Neural Network.

Deep CNN-based Features for Hand-Drawn Sketch Recognition Via Transfer Learning Approach

Self-Adaptive Computational Aesthetic Evaluation of Chinese Ink Paintings Based on Deep Learning

Deep Neural Networks for Free-Hand Sketch Recognition.

Inpainting with Sketch Reconstruction and Comprehensive Feature Selection

On Learning Semantic Representations for Large-Scale Abstract Sketches

Entropy Information‐based Heterogeneous Deep Selective Fused Features Using Deep Convolutional Neural Network for Sketch Recognition

Mixed attention dense network for sketch classification

The image annotation algorithm using convolutional features from intermediate layer of deep learning

Sketch-R2CNN : An RNN-Rasterization-CNN Architecture for Vector Sketch Recognition

A Multi-Layer Deep Fusion Convolutional Neural Network for Sketch Based Image Retrieval

Multi-column Point-CNN for Sketch Segmentation

Sequential Dual Deep Learning with Shape and Texture Features for Sketch Recognition

Deep Self-Supervised Representation Learning for Free-Hand Sketch

A hierarchical residual network with compact triplet-center loss for sketch recognition

Deep Learning for Free-Hand Sketch: A Survey