Photographic style transfer

Li Wang,Zhao Wang,Xiaosong Yang,Shi-Min Hu,Jianjun Zhang
DOI: https://doi.org/10.1007/s00371-018-1609-4
IF: 2.835
2018-01-01
The Visual Computer
Abstract:Image style transfer has attracted much attention in recent years. However, results produced by existing works still have lots of distortions. This paper investigates the CNN-based artistic style transfer work specifically and finds out the key reasons for distortion coming from twofold: the loss of spatial structures of content image during content-preserving process and unexpected geometric matching introduced by style transformation process. To tackle this problem, this paper proposes a novel approach consisting of a dual-stream deep convolution network as the loss network and edge-preserving filters as the style fusion model. Our key contribution is the introduction of an additional similarity loss function that constrains both the detail reconstruction and style transfer procedures. The qualitative evaluation shows that our approach successfully suppresses the distortions as well as obtains faithful stylized results compared to state-of-the-art methods.
What problem does this paper attempt to address?