GC-GAN: Photo Cartoonization Using Guided Cartoon Generative Adversarial Network

Jiachen Zhang,Huantong Hou,Jingjing Chen,Donglong Chen
DOI: https://doi.org/10.1007/978-3-031-44192-9_6
2023-01-01
Abstract:Image cartoonization, a subfield of image translation, has gained increasing attention in recent years. However, the overall performance of existing methods is limited by shortcomings such as poorly fitting regions. To address these issues, our paper proposes the Guided Cartoon Generative Adversarial Network (GC-GAN). Our approach introduces a segmentation step before the training process, which splits and guides mixed training images into a human face set and a scenery set. This enables our model to extract features specifically from cartoon faces and generate more realistic results. Furthermore, we include a loss function called triplet loss in our framework, which drives the network to bring output closer to a referenced image and focus more on the detailed parts of the training images. This improves the overall quality of the generated images and addresses the issue of poorly fitting regions. Compared to the state-of-the-art White-box CartoonGAN, our work improves Fréchet Inception Distance by 18.7% and Kernel Inception Distance by 17.6%, respectively. Additionally, our work surpasses AnimeGAN in terms of Fréchet Inception Distance by 40.7% and Kernel Inception Distance by 47.4%.
What problem does this paper attempt to address?