Sketch to Image synthesis using attention based contextual GAN

Sudharson S,Shaik Nawab Mudassir,R. P. Kumar
DOI: https://doi.org/10.1109/ICCCNT56998.2023.10306444
2023-07-06
Abstract:Generating realistic and high-quality images from sketches remains a challenging task in the fields of computer vision and graphics. Although deep learning approaches, specifically Generative Adversarial Networks (GANs), have showed promise in generating images in this area, issues such as image quality and diversity persist. In this study, a novel approach for generating human faces from sketches was proposed by leveraging a contextual GAN with attention mechanisms and ResNet-50 feature extraction. Proposed method aims to enhance image quality by incorporating attention mechanisms. Specifically, we extract relevant features from the input sketch using the ResNet-50 feature extraction technique, which are then utilized to guide the image synthesis process. To evaluate the model’s performance, a comparison is made with existing approaches using the CHUK dataset, assessing the results based on the Structural Similarity Index (SSIM) score. The proposed technique achieves an impressive SSIM score of 0.78, outperforming other methods in generating realistic and faithful representations of the original images.
Computer Science
What problem does this paper attempt to address?