Abstract:Preserving important textures of the content image and achieving prominent style transfer results remains a challenge in the field of image style transfer. This challenge arises from the entanglement between color and texture during the style transfer process. To address this challenge, we propose an end-to-end network that incorporates adaptive weighted least squares (AWLS) filter, iterative least squares (ILS) filter, and channel separation. Given a content image ( $\mathcal {C}$ ) and a reference style image ( $\mathcal {S}$ ), we begin by separating the RGB channels and utilizing ILS filter to decompose them into structure and texture layers. We then perform style transfer on the structural layers using WCT $^{2}$ (incorporating wavelet pooling and unpooling techniques for whitening and coloring transforms) in the R, G, and B channels, respectively. We address the texture distortion caused by WCT $^{2}$ with a texture enhancing (TE) module in the structural layer. Furthermore, we propose an estimating and compensating for the structure loss (ECSL) module. In the ECSL module, with the AWLS filter and the ILS filter, we estimate the texture loss caused by TE, convert the loss of the structural layer to the loss of the texture layer, and compensate for the loss in the texture layer. The final structural layer and the texture layer are merged into the channel style transfer results in the separated R, G, and B channels into the final style transfer result. Thereby, this enables a more complete texture preservation and a significant style transfer process. To evaluate our method, we utilize quantitative experiments using various metrics, including NIQE, AG, SSIM, PSNR, and a user study. The experimental results demonstrate the superiority of our approach over the previous state-of-the-art methods.

Image Artistic Style Transfer Based on Color Distribution Preprocessing.

Style Permutation for Diversified Arbitrary Style Transfer

Artistic Style Transfer with Internal-external Learning and Contrastive Learning

Diverse Image Style Transfer Via Invertible Cross-Space Mapping

ArtBank: Artistic Style Transfer with Pre-trained Diffusion Model and Implicit Style Prompt Bank

Optimal Transport of Deep Feature for Image Style Transfer

Learning Structure-Aware Transformations for Arbitrary Image Style Transfer

GLStyleNet: Exquisite Style Transfer Combining Global and Local Pyramid Features

Diversified Patch-based Style Transfer with Shifted Style Normalization

Image Neural Style Transfer with Preserving the Salient Regions.

Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer

Interactive Artistic Multi-style Transfer.

A Scale-adaptive Color Preservation Neural Style Transfer Method

Photographic style transfer

NCST: Neural-based Color Style Transfer for Video Retouching

Aesthetic-Aware Image Style Transfer.

Structure-Preserving Neural Style Transfer

Neural Preset for Color Style Transfer

Computational Decomposition of Style for Controllable and Enhanced Style Transfer

Towards High-Quality Photorealistic Image Style Transfer

The contour image style-transfer-based convolutional neural network