Abstract:Preserving important textures of the content image and achieving prominent style transfer results remains a challenge in the field of image style transfer. This challenge arises from the entanglement between color and texture during the style transfer process. To address this challenge, we propose an end-to-end network that incorporates adaptive weighted least squares (AWLS) filter, iterative least squares (ILS) filter, and channel separation. Given a content image ( $\mathcal {C}$ ) and a reference style image ( $\mathcal {S}$ ), we begin by separating the RGB channels and utilizing ILS filter to decompose them into structure and texture layers. We then perform style transfer on the structural layers using WCT $^{2}$ (incorporating wavelet pooling and unpooling techniques for whitening and coloring transforms) in the R, G, and B channels, respectively. We address the texture distortion caused by WCT $^{2}$ with a texture enhancing (TE) module in the structural layer. Furthermore, we propose an estimating and compensating for the structure loss (ECSL) module. In the ECSL module, with the AWLS filter and the ILS filter, we estimate the texture loss caused by TE, convert the loss of the structural layer to the loss of the texture layer, and compensate for the loss in the texture layer. The final structural layer and the texture layer are merged into the channel style transfer results in the separated R, G, and B channels into the final style transfer result. Thereby, this enables a more complete texture preservation and a significant style transfer process. To evaluate our method, we utilize quantitative experiments using various metrics, including NIQE, AG, SSIM, PSNR, and a user study. The experimental results demonstrate the superiority of our approach over the previous state-of-the-art methods.

Purifying naturalistic images through a real-time style transfer semantics network

Image Purification Through Controllable Neural Style Transfer

Image Purification Networks: Real-time Style Transfer with Semantics through Feed-forward Synthesis

Purifying real images with an attention-guided style transfer network for gaze estimation

Mask-Guided Style Transfer Network for Purifying Real Images

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Image Neural Style Transfer with Preserving the Salient Regions.

Towards High-Quality Photorealistic Image Style Transfer

Refining Synthetic Images with Semantic Layouts by Adversarial Training.

Photorealistic Style Transfer Guided by Global Information

Photorealistic Style Transfer Via Adaptive Filtering and Channel Seperation

ColoristaNet for Photorealistic Video Style Transfer

High-Resolution Network for Photorealistic Style Transfer

Real-time Localized Photorealistic Video Style Transfer

Real-time Universal Style Transfer on High-resolution Images via Zero-channel Pruning

Language-guided Semantic Style Transfer of 3D Indoor Scenes

Guiding Intelligent Surveillance System by Learning-by-synthesis Gaze Estimation

Real-time Image Style Transformation Based on Deep Learning.

Stylized Image Denoising Via Noise Style Transfer and Quasi Siamese Network.