Abstract:Different artists have their unique painting styles, which can be hardly recognized by ordinary people without professional knowledge. How to intelligently analyze such artistic styles via underlying features remains to be a challenging research problem. In this paper, we propose a novel multi-task feature fusion architecture (MTFFNet), for cognitive classification of traditional Chinese paintings. Specifically, by taking the full advantage of the pre-trained DenseNet as backbone, MTFFNet benefits from the fusion of two different types of feature information: semantic and brush stroke features. These features are learned from the RGB images and auxiliary gray-level co-occurrence matrix (GLCM) in an end-to-end manner, to enhance the discriminative power of the features for the first time. Through abundant experiments, our results demonstrate that our proposed model MTFFNet achieves significantly better classification performance than many state-of-the-art approaches.In this paper, an end-to-end multi-task feature fusion method for Chinese painting classification is proposed. We come up with a new model named MTFFNet, composed of two branches, in which one branch is top-level RGB feature learning and the other branch is low-level brush stroke feature learning. The semantic feature learning branch takes the original image of traditional Chinese painting as input, extracting the color and semantic information of the image, while the brush feature learning branch takes the GLCM feature map as input, extracting the texture and edge information of the image. Multi-kernel learning SVM (supporting vector machine) is selected as the final classifier. Evaluated by experiments, this method improves the accuracy of Chinese painting classification and enhances the generalization ability. By adopting the end-to-end multi-task feature fusion method, MTFFNet could extract more semantic features and texture information in the image. When compared with state-of-the-art classification method for Chinese painting, the proposed method achieves much higher accuracy on our proposed datasets, without lowering speed or efficiency. The proposed method provides an effective solution for cognitive classification of Chinese ink painting, where the accuracy and efficiency of the approach have been fully validated.

Multitask painting categorization by deep multibranch neural network

OmniArt: Multi-task Deep Learning for Artistic Data Analysis

Author Recognition of Fine-Art Paintings

From Part to whole: Who is behind the painting?

Artistic Style Recognition: Combining Deep and Shallow Neural Networks for Painting Classification

Collaborative Neural Painting

MTFFNet: a Multi-task Feature Fusion Framework for Chinese Painting Classification

Deep Ensemble Art Style Recognition

Inferring Painting Style with Multi-Task Dictionary Learning.

Research on Cross-Contrast Neural Network Based Intelligent Painting: Taking Oil Painting Language Classification as an Example

Painting Modeling Language Based on Convolution Neural Networks in Digital Media Art

Multi-layer and multi-order fine-grained feature learning for artwork attribute recognition

Intelligent Painting Identification Based on Image Perception in Multimedia Enterprise.

Artist, Style And Year Classification Using Face Recognition And Clustering With Convolutional Neural Networks

Calligraphy and Painting Identification 3D-CNN Model Based on Hyperspectral Image MNF Dimensionality Reduction

Machine: The New Art Connoisseur

Multi-Task Convolutional Neural Network for Image Aesthetic Assessment

How to Represent Paintings: A Painting Classification Using Artistic Comments

A Data Set and a Convolutional Model for Iconography Classification in Paintings

ST-SACLF: Style Transfer Informed Self-Attention Classifier for Bias-Aware Painting Classification

Application of Multitask Joint Sparse Representation Algorithm in Chinese Painting Image Classification