Abstract:Painting style transfer is an attractive and challenging computer vision problem that aims to transfer painting styles onto natural images. Existing advanced methods tackle this problem from the perspective of Neural Style Transfer (NST) or unsupervised cross-domain image translation. For both two types of methods, attention has been focused on reproducing artistic painting styles of representative artists (e.g., Vincent Van Gogh). In this paper, instead of transferring styles of artistic paintings, we focus on automatic generation of realistic paintings, for example, making the machine draw a gouache before a still life, paint a sketch of a landscape, or draw a pen-and-ink portrait of a person, etc. Besides capturing the precise target styles, synthesis of realistic paintings is more demanding in preserving original content features and image structures, for which existing advanced methods are not sufficient to generate satisfactory results. Aimed at this problem, we propose RPD-GAN (Realistic Painting Drawing Generative Adversarial Network), an unsupervised cross-domain image translation framework for realistic painting style transfer. At the heart of our model is the decomposition of the image stylization mapping into four stages: feature encoding, feature de-stylization, feature re-stylization, and feature decoding, where the functionalities of these stages are implemented by additionally embedding a content-consistency constraint and a style-alignment constraint at feature space to the classic CycleGAN architecture. By enforcing these constraints, both the content-preserving and style-capturing capabilities of the model are enhanced, leading to higher-quality stylization results. Extensive experiments demonstrate the effectiveness and superiority of our RPD-GAN in drawing realistic paintings.

Generating Chinese Classical Landscape Paintings Based on Cycle-Consistent Adversarial Networks

Creative and Diverse Artwork Generation Using Adversarial Networks

DLP-GAN: learning to draw modern Chinese landscape photos with generative adversarial network

Innovative Application of Chinese Landscape Culture Painting Elements in AI Art Generation

End-to-End Chinese Landscape Painting Creation Using Generative Adversarial Networks

Deep neural networks for Chinese traditional landscape painting creation

Contour-enhanced CycleGAN framework for style transfer from scenery photos to Chinese landscape paintings

Semi-supervised Chinese Poem-to-Painting Generation via Cycle-consistent Adversarial Networks

RPD-GAN: Learning to Draw Realistic Paintings with Generative Adversarial Network

CCLAP: Controllable Chinese Landscape Painting Generation via Latent Diffusion Model

Deep Learning-Based Image Style Transformation Research on Landscape Paintings of Wei, Jin and North-South Dynasties

CS-GAN: Cross-Structure Generative Adversarial Networks for Chinese Calligraphy Translation.

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

Training Generative Adversarial Networks in One Stage

ChipGAN: A Generative Adversarial Network for Chinese Ink Wash Painting Style Transfer.

Chinese character style transfer based on multi-scale GAN

Deep Learning-Based Application of Image Style Transfer

Loss functions for Style Transfer with CycleGAN

A Generative Adversarial Network AMS-CycleGAN for Multi-Style Image Transformation

An Ancient Chinese Painting Restoration Method Based on Improved Generative Adversarial Network

GAN-Based Unpaired Chinese Character Image Translation Via Skeleton Transformation and Stroke Rendering.