Abstract:Different artists have their unique painting styles, which can be hardly recognized by ordinary people without professional knowledge. How to intelligently analyze such artistic styles via underlying features remains to be a challenging research problem. In this paper, we propose a novel multi-task feature fusion architecture (MTFFNet), for cognitive classification of traditional Chinese paintings. Specifically, by taking the full advantage of the pre-trained DenseNet as backbone, MTFFNet benefits from the fusion of two different types of feature information: semantic and brush stroke features. These features are learned from the RGB images and auxiliary gray-level co-occurrence matrix (GLCM) in an end-to-end manner, to enhance the discriminative power of the features for the first time. Through abundant experiments, our results demonstrate that our proposed model MTFFNet achieves significantly better classification performance than many state-of-the-art approaches.In this paper, an end-to-end multi-task feature fusion method for Chinese painting classification is proposed. We come up with a new model named MTFFNet, composed of two branches, in which one branch is top-level RGB feature learning and the other branch is low-level brush stroke feature learning. The semantic feature learning branch takes the original image of traditional Chinese painting as input, extracting the color and semantic information of the image, while the brush feature learning branch takes the GLCM feature map as input, extracting the texture and edge information of the image. Multi-kernel learning SVM (supporting vector machine) is selected as the final classifier. Evaluated by experiments, this method improves the accuracy of Chinese painting classification and enhances the generalization ability. By adopting the end-to-end multi-task feature fusion method, MTFFNet could extract more semantic features and texture information in the image. When compared with state-of-the-art classification method for Chinese painting, the proposed method achieves much higher accuracy on our proposed datasets, without lowering speed or efficiency. The proposed method provides an effective solution for cognitive classification of Chinese ink painting, where the accuracy and efficiency of the approach have been fully validated.

Feature Fusion and Decomposition: Exploring a New Way for Chinese Calligraphy Style Classification

Chinese Calligraphic Style Representation for Recognition

Self-Adaptive Computational Aesthetic Evaluation of Chinese Ink Paintings Based on Deep Learning

A Novel CNN Model for Classification of Chinese Historical Calligraphy Styles in Regular Script Font

Inkthetics: A Comprehensive Computational Model for Aesthetic Evaluation of Chinese Ink Paintings.

ShufaNet: Classification method for calligraphers who have reached the professional level

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

MTFFNet: a Multi-task Feature Fusion Framework for Chinese Painting Classification

Automatic Generation of Chinese Character Using Features Fusion from Calligraphy and Font

Detecting Chinese Calligraphy Style Consistency by Deep Learning and One-Class SVM

Chinese Calligraphy Character Image Recognition and Its Applications in Web and Wechat Applet Platform

Aesthetic Visual Quality Evaluation of Chinese Handwritings.

Calligraphy Word Style Recognition by KNN Based Feature Library Filtering

CalliGAN: Style and Structure-aware Chinese Calligraphy Character Generator

Discovering Calligraphy Style Relationships by Supervised Learning Weighted Random Walk Model

Evaluating Brush Movements for Chinese Calligraphy: a Computer Vision Based Approach

Convolutional Neural Network-Based Chinese Ink-Painting Artistic Style Extraction

Calligraphy and Painting Identification 3D-CNN Model Based on Hyperspectral Image MNF Dimensionality Reduction

A New Artistic Information Extraction Method with Multi Channels and Guided Filters for Calligraphy Works

Artistic Features Extraction from Chinese Calligraphy Works Via Regional Guided Filter with Reference Image

CalliffusionV2: Personalized Natural Calligraphy Generation with Flexible Multi-modal Control