Abstract:Different artists have their unique painting styles, which can be hardly recognized by ordinary people without professional knowledge. How to intelligently analyze such artistic styles via underlying features remains to be a challenging research problem. In this paper, we propose a novel multi-task feature fusion architecture (MTFFNet), for cognitive classification of traditional Chinese paintings. Specifically, by taking the full advantage of the pre-trained DenseNet as backbone, MTFFNet benefits from the fusion of two different types of feature information: semantic and brush stroke features. These features are learned from the RGB images and auxiliary gray-level co-occurrence matrix (GLCM) in an end-to-end manner, to enhance the discriminative power of the features for the first time. Through abundant experiments, our results demonstrate that our proposed model MTFFNet achieves significantly better classification performance than many state-of-the-art approaches.In this paper, an end-to-end multi-task feature fusion method for Chinese painting classification is proposed. We come up with a new model named MTFFNet, composed of two branches, in which one branch is top-level RGB feature learning and the other branch is low-level brush stroke feature learning. The semantic feature learning branch takes the original image of traditional Chinese painting as input, extracting the color and semantic information of the image, while the brush feature learning branch takes the GLCM feature map as input, extracting the texture and edge information of the image. Multi-kernel learning SVM (supporting vector machine) is selected as the final classifier. Evaluated by experiments, this method improves the accuracy of Chinese painting classification and enhances the generalization ability. By adopting the end-to-end multi-task feature fusion method, MTFFNet could extract more semantic features and texture information in the image. When compared with state-of-the-art classification method for Chinese painting, the proposed method achieves much higher accuracy on our proposed datasets, without lowering speed or efficiency. The proposed method provides an effective solution for cognitive classification of Chinese ink painting, where the accuracy and efficiency of the approach have been fully validated.

From Part to whole: Who is behind the painting?

Knowing a Tree from the Forest

Learning to Recognize the Art Style of Paintings Using Multi-cues

Author Recognition of Fine-Art Paintings

Knowing a tree from the forest: art image retrieval using a society of profiles.

Inferring Painting Style with Multi-Task Dictionary Learning.

Multitask painting categorization by deep multibranch neural network

MTFFNet: a Multi-task Feature Fusion Framework for Chinese Painting Classification

A new method for visual stylometry on impressionist paintings

GalleryGPT: Analyzing Paintings with Large Multimodal Models

Understanding Art through Multi-Modal Retrieval in Paintings

Intelligent Painting Identification Based on Image Perception in Multimedia Enterprise.

DeepArt: Learning Joint Representations of Visual Arts.

How to Represent Paintings: A Painting Classification Using Artistic Comments

Application of Multitask Joint Sparse Representation Algorithm in Chinese Painting Image Classification

Explain Me the Painting: Multi-Topic Knowledgeable Art Description Generation

Supervised Heterogeneous Sparse Feature Selection for Chinese Paintings Classification

Automatic analysis of artistic paintings using information-based measures

Sparse Representation Based Complete Kernel Marginal Fisher Analysis Framework for Computational Art Painting Categorization

Generating Emotion Descriptions for Fine Art Paintings Via Multiple Painting Representations.

Image Captioning on Fine Art Paintings via Virtual Paintings.