Abstract:Recently, with the revolutionary neural style transferring methods, creditable paintings can be synthesized automatically from content images and style images. However, when it comes to the task of applying a painting's style to an anime sketch, these methods will just randomly colorize sketch lines as outputs and fail in the main task: specific style tranfer. In this paper, we integrated residual U-net to apply the style to the gray-scale sketch with auxiliary classifier generative adversarial network (AC-GAN). The whole process is automatic and fast, and the results are creditable in the quality of art style as well as colorization.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: **How to apply the styles of existing paintings to anime sketches, thereby achieving high - quality artistic style transfer and coloring**. Specifically, the existing neural style transfer methods (such as Neural Style Transfer) perform poorly when dealing with sketches. They randomly color the sketch lines and are unable to accurately transfer the style of a specific painting to the sketch. In addition, some methods based on conditional generative adversarial networks (cGAN), such as Pix2Pix, can directly convert sketches into paintings, but they cannot fully utilize the style information of existing paintings. To overcome these problems, the author proposes a new method, which combines an enhanced Residual U - Net and an Auxiliary Classifier Generative Adversarial Network (AC - GAN) to achieve automatic and fast sketch - style transfer. This method can not only handle the information imbalance problem between sketches and paintings, but also introduce a global style hint to guide the generation process, thereby generating color images with high - quality artistic styles. ### Main contributions: 1. **Feed - forward network**: It realizes the automated process of applying painting styles to sketches. 2. **Enhanced Residual U - Net**: It can handle paired images with information imbalance. 3. **Additional loss function**: By introducing two Guide Decoders, it ensures that the intermediate layers can obtain stable gradients. 4. **Improved discriminator**: Based on AC - GAN, it can simultaneously judge whether the input is real and classify the style, so as to better adapt to paintings of different styles. Through these improvements, the author has successfully solved the deficiencies of existing methods in the sketch - style transfer task and provided a more reliable and efficient solution.

Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Creative and Diverse Artwork Generation Using Adversarial Networks

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

Mural Sketch Generation via Style-aware Convolutional Neural Network.

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Automatic Color Sketch Generation Using Deep Style Transfer

CCST-GAN: Generative Adversarial Networks for Chinese Calligraphy Style Transfer

Research on Image Generation and Style Transfer Algorithm Based on Deep Learning

A Method for Style Transfer from Artistic Images Based on Depth Extraction Generative Adversarial Network

Painting Style-Aware Manga Colorization Based on Generative Adversarial Networks

Art Style Transfer of Oil Painting Based on Parallel Convolutional Neural Network

Image Style Transfering Based on StarGAN and Class Encoder

Digital Image Art Style Transfer Algorithm Based on CycleGAN

Multi-granularity Brushstrokes Network for Universal Style Transfer

User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks.

Linear-ResNet GAN-based anime style transfer of face images

DRB-GAN: A Dynamic ResBlock Generative Adversarial Network for Artistic Style Transfer

Transform a Simple Sketch to a Chinese Painting by a Multiscale Deep Neural Network

Deep Learning-Based Application of Image Style Transfer

Cvstgan: A Controllable Generative Adversarial Network for Video Style Transfer of Chinese Painting