DAU-GAN: Unsupervised Object Transfiguration via Deep Attention Unit.

Zihan Ye,Fan Lyu,Jinchang Ren,Yu Sun,Qiming Fu,Fuyuan Hu
DOI: https://doi.org/10.1007/978-3-030-00563-4_12
2018-01-01
Abstract:Object transfiguration aims to translate objects in image from a kind to another, which is a subtask of image translation. Recently, researchers have proposed many effective approaches for object transfiguration. However, most of them ignore the difference between target objects and background, which would make background deformation, discolor and other problems. We propose a novel attention-based model for unsupervised object transfiguration called Deep Attention Units Generative Adversarial Network (DAU-GAN). We utilize spatial consistencies of objects and background to enable model to preserve background of image. Such an attention-based design enables DAU-GAN to enhance the expression of meaningful features and let the model able to distinguish specific objects and background in images. Experimental results demonstrate that our approach improves the performance of object transfiguration as well as effectively preserves background.
What problem does this paper attempt to address?