Abstract:Different artists have their unique painting styles, which can be hardly recognized by ordinary people without professional knowledge. How to intelligently analyze such artistic styles via underlying features remains to be a challenging research problem. In this paper, we propose a novel multi-task feature fusion architecture (MTFFNet), for cognitive classification of traditional Chinese paintings. Specifically, by taking the full advantage of the pre-trained DenseNet as backbone, MTFFNet benefits from the fusion of two different types of feature information: semantic and brush stroke features. These features are learned from the RGB images and auxiliary gray-level co-occurrence matrix (GLCM) in an end-to-end manner, to enhance the discriminative power of the features for the first time. Through abundant experiments, our results demonstrate that our proposed model MTFFNet achieves significantly better classification performance than many state-of-the-art approaches.In this paper, an end-to-end multi-task feature fusion method for Chinese painting classification is proposed. We come up with a new model named MTFFNet, composed of two branches, in which one branch is top-level RGB feature learning and the other branch is low-level brush stroke feature learning. The semantic feature learning branch takes the original image of traditional Chinese painting as input, extracting the color and semantic information of the image, while the brush feature learning branch takes the GLCM feature map as input, extracting the texture and edge information of the image. Multi-kernel learning SVM (supporting vector machine) is selected as the final classifier. Evaluated by experiments, this method improves the accuracy of Chinese painting classification and enhances the generalization ability. By adopting the end-to-end multi-task feature fusion method, MTFFNet could extract more semantic features and texture information in the image. When compared with state-of-the-art classification method for Chinese painting, the proposed method achieves much higher accuracy on our proposed datasets, without lowering speed or efficiency. The proposed method provides an effective solution for cognitive classification of Chinese ink painting, where the accuracy and efficiency of the approach have been fully validated.

Learning Multi-Granularity Features for Re-Identifying Figures in Portrait Thangka Images

Portrait Thangka Image Retrieval via Figure Re-identification

Learning Discriminative Features with Multiple Granularities for Person Re-Identification

Multi-Granularity Hypergraphs and Adversarial Complementary Learning for Person Re-identification.

Multi-Granularity Mutual Learning Network for Object Re-Identification

Multi-Granularity Representation Learning for Sketch-based Dynamic Face Image Retrieval

Vision transformer with multiple granularities for person re-identification

Hybrid Granularities Transformer for Fine-Grained Image Recognition

Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identification

Group Re-Identification: Leveraging and Integrating Multi-Grain Information.

Multi-layer and multi-order fine-grained feature learning for artwork attribute recognition

Person re-identification based on multi-scale feature learning

Hybrid-attention guided network with multiple resolution features for person re-identification

MTFFNet: a Multi-task Feature Fusion Framework for Chinese Painting Classification

Feature preserving GAN and multi-scale feature enhancement for domain adaption person Re-identification

Multiple Granularity Descriptors for Fine-Grained Categorization.

Multi-granular inter-frame relation exploration and global residual embedding for video-based person re-identification

Resolution Adaptive Feature Extracting and Fusing Framework for Person Re-Identification

The Research of Group Re-identification from Multiple Cameras

Fine-grained image recognition via trusted multi-granularity information fusion