Data augmentation techniques based on deep learning for Chinese paintings

Qingchen Nie,Yinghui Wang,Zhuwen Zhao,Xinquan Luo

DOI: https://doi.org/10.1117/12.3008104

2023-11-14

Abstract:Chinese paintings are generally divided into calligraphy, white drawing, and brushwork, often painted with ink, metallic pigments, and vegetable pigments using rice paper and cloth with distinct textures as physical carriers, and have a distinctive artistic style. In this paper, we propose a data augmentation method for Chinese-style paintings, which can better generate digital images that match the characteristics of Chinese-style paintings and are as semantically realistic as possible. First, we use SinGAN to train a single Chinese painting and generate 50 data augmentation results, which can reproduce the image texture and brush stroke style of a single Chinese painting. Subsequently, the Repaint model is used to semantically improve the data augmentation results to make them more realistic from a subjective perspective. Finally, we verify the effect of data augmentation in the image classification task based on VGG 16 and InceptionV3 and compare the effect of traditional data augmentation techniques with the deep-learning data augmentation technique proposed in this paper. The experimental results demonstrate that the training set processed by the deep-learning data augmentation technique can improve the prediction accuracy of the classification model, while the prediction accuracy of the classification model is improved again after training on the training set processed by the combination method of the traditional data augmentation technique and the deep-learning technique. This indicates that deep-learning data augmentation techniques can improve the efficiency of image tasks and avoid overfitting, which can be used in the study of the digitization of Chinese paintings.

Art,Engineering,Computer Science