Style Transfer: From Stitching to Neural Networks

Xinhe Xu,Zhuoer Wang,Yihan Zhang,Yizhou Liu,Zhaoyue Wang,Zhihao Xu,Muhan Zhao,Huaiying Luo
2024-09-16
Abstract:This article compares two style transfer methods in image processing: the traditional method, which synthesizes new images by stitching together small patches from existing images, and a modern machine learning-based approach that uses a segmentation network to isolate foreground objects and apply style transfer solely to the background. The traditional method excels in creating artistic abstractions but can struggle with seamlessness, whereas the machine learning method preserves the integrity of foreground elements while enhancing the background, offering improved aesthetic quality and computational efficiency. Our study indicates that machine learning-based methods are more suited for real-world applications where detail preservation in foreground elements is essential.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to compare the performance of traditional methods and deep - learning - based methods in image style transfer. Specifically: 1. **Evaluate the performance of traditional style transfer methods when dealing with complex - style images**: - Firstly, the paper conducts a comprehensive evaluation of traditional style transfer methods, especially their performance when dealing with complex - style images. Traditional style transfer methods mainly rely on statistical analysis and patch - based matching techniques. These methods work well when dealing with simple - style images, but have limitations when dealing with complex - style images, such as difficulty in maintaining global consistency and style accuracy. 2. **Compare the advantages and disadvantages of traditional methods and deep - learning - based methods**: - The paper conducts experiments using the PASCAL VOC 2012 dataset to compare the performance of traditional methods and deep - learning - based methods in generating stylized images. The following aspects are mainly evaluated: - **Color transfer**: Deep - learning - based methods perform better in color transfer, and the generated images have more vivid and natural colors. - **Line and structure information**: Traditional methods perform better in retaining the main structural information of the input image, but may produce unnatural visual artifacts. Although deep - learning - based methods may slightly change the spatial information, they generally provide a more coherent visual effect. - **Ability to process complex - style images**: Deep - learning - based methods show higher flexibility and robustness when dealing with complex - style images, and can better capture and apply complex style patterns. 3. **Provide suggestions for future research**: - The paper also discusses future research directions, including further evaluating the cost - effectiveness of the two methods and exploring hybrid techniques that combine traditional methods and deep - learning methods, in order to achieve better results in style transfer applications. In conclusion, this paper aims to reveal the advantages and limitations of traditional style transfer methods and deep - learning - based style transfer methods in different application scenarios through systematic comparative research, and provide guidance for future scientific research and practical applications.