Painterly Image Generation Using Scene-Aware Style Transferring

M. Toyoura,Noriyuki Abe,Xiaoyang Mao
DOI: https://doi.org/10.1109/CW.2016.18
2016-09-01
Abstract:In this paper, we propose a method for painterly image generation that uses an example painting with a similar scene to reflect the style of an original work in great detail. The styles of specific painters and methods often employ different colors and brushwork for each individual subject. Likewise, the connections between various subjects in a work also affect the colors and brushwork used. Our method takes input images, searches an example database for paintings with similar scenes, i.e., paintings in which the subjects have similar positional relationships and connections, and transfers the color and brushwork of the paintings to the corresponding subjects of the target images to generate painterly images that reflect specific styles in great detail. In order to ensure close linkage between various elements and to reproduce styles faithfully, our method applies the GIST approach proposed by Oliva et al. to the process of searching for paintings with similar scenes before performing style transfers.
What problem does this paper attempt to address?