Abstract:Different artists have their unique painting styles, which can be hardly recognized by ordinary people without professional knowledge. How to intelligently analyze such artistic styles via underlying features remains to be a challenging research problem. In this paper, we propose a novel multi-task feature fusion architecture (MTFFNet), for cognitive classification of traditional Chinese paintings. Specifically, by taking the full advantage of the pre-trained DenseNet as backbone, MTFFNet benefits from the fusion of two different types of feature information: semantic and brush stroke features. These features are learned from the RGB images and auxiliary gray-level co-occurrence matrix (GLCM) in an end-to-end manner, to enhance the discriminative power of the features for the first time. Through abundant experiments, our results demonstrate that our proposed model MTFFNet achieves significantly better classification performance than many state-of-the-art approaches.In this paper, an end-to-end multi-task feature fusion method for Chinese painting classification is proposed. We come up with a new model named MTFFNet, composed of two branches, in which one branch is top-level RGB feature learning and the other branch is low-level brush stroke feature learning. The semantic feature learning branch takes the original image of traditional Chinese painting as input, extracting the color and semantic information of the image, while the brush feature learning branch takes the GLCM feature map as input, extracting the texture and edge information of the image. Multi-kernel learning SVM (supporting vector machine) is selected as the final classifier. Evaluated by experiments, this method improves the accuracy of Chinese painting classification and enhances the generalization ability. By adopting the end-to-end multi-task feature fusion method, MTFFNet could extract more semantic features and texture information in the image. When compared with state-of-the-art classification method for Chinese painting, the proposed method achieves much higher accuracy on our proposed datasets, without lowering speed or efficiency. The proposed method provides an effective solution for cognitive classification of Chinese ink painting, where the accuracy and efficiency of the approach have been fully validated.

Intelligent Painting Identification Based on Image Perception in Multimedia Enterprise.

Knowing a Tree from the Forest

Learning to Recognize the Art Style of Paintings Using Multi-cues

Knowing a tree from the forest: art image retrieval using a society of profiles.

Research on Cross-Contrast Neural Network Based Intelligent Painting: Taking Oil Painting Language Classification as an Example

Self-Adaptive Computational Aesthetic Evaluation of Chinese Ink Paintings Based on Deep Learning

Inkthetics: A Comprehensive Computational Model for Aesthetic Evaluation of Chinese Ink Paintings.

Author Recognition of Fine-Art Paintings

Painting and calligraphy identification method based on hyperspectral imaging and convolution neural network

MCCFNet: Multi-channel Color Fusion Network For Cognitive Classification of Traditional Chinese Paintings

Emotion Recognition of Chinese Paintings at the Thirteenth National Exhibition of Fines Arts in China Based on Advanced Affective Computing

A painting authentication method based on multi-scale spatial-spectral feature fusion and convolutional neural network

Artistic Style Recognition: Combining Deep and Shallow Neural Networks for Painting Classification

Calligraphy and Painting Identification 3D-CNN Model Based on Hyperspectral Image MNF Dimensionality Reduction

SAS: Painting Detection and Recognition Via Smart Art System with Mobile Devices.

Painting Modeling Language Based on Convolution Neural Networks in Digital Media Art

Application of Intelligent Image Color Technology in Teaching Chinese Painting Color

MTFFNet: a Multi-task Feature Fusion Framework for Chinese Painting Classification

The Performance of Two CNN Methods in Artworks Aesthetic Feature Recognition

Extensive Classification of Visual Art Paintings for Enhancing Education System Using Hybrid SVM-ANN with Sparse Metric Learning Based on Kernel Regression.

Adaptive Weighted Matching of Deep Convolutional Features for Painting Retrieval