Abstract:Face image-sketch synthesis is widely applied in law enforcement and digital entertainment fields. Despite the extensive progression in face image-sketch synthesis, there are few methods focusing on generating a color face image from a sketch. The existing methods pay less attention to learning the illumination or highlight distribution on the face region. However, the illumination is the key factor that makes the generated color face image looks vivid and realistic. Moreover, existing methods tend to employ some image preprocessing technologies and facial region patching approaches to generate high-quality face images, which results in the high complexity and memory consumption in practice. In this paper, we propose a novel end-to-end generative adversarial fusion model, called GAF, which fuses two U-Net generators and a discriminator by jointly learning the content and adversarial loss functions. In particular, we propose a parametric tanh activation function to learn and control illumination highlight distribution over faces, which is integrated between the two U-Net generators by an illumination distribution layer. Additionally, we fuse the attention mechanism into the second U-Net generator of GAF to keep the identity consistency and refine the generated facial details. The qualitative and quantitative experiments on the public benchmark datasets show that the proposed GAF has better performance than existing image-sketch synthesis methods in synthesized face image quality (FSIM) and face recognition accuracy (NLDA). Meanwhile, the good generalization ability of GAF has also been verified. To further demonstrate the reliability and authenticity of face images generated using GAF, we use the generated face image to attack the well-known face recognition system. The result shows that the face images generated by GAF can maintain identity consistency and well maintain everyone’s unique facial characteristics, which can be further used in the benchmark of facial spoofing. Moreover, the experiments are implemented to verify the effectiveness and rationality of the proposed parametric tanh activation function and attention mechanism in GAF.

SynFAGnet: A Fully Automated Generative Network for Realistic Fire Image Generation

FGL-GAN: Global-Local Mask Generative Adversarial Network for Flame Image Composition

Infrared/Visible Light Fire Image Fusion Method Based on Generative Adversarial Network of Wavelet-Guided Pooling Vision Transformer

Fire image enhancement method based on generative adversarial networks for improving fire detection performance through cameras

A generative adversarial network (GAN) approach to creating synthetic flame images from experimental data

DEEPFAKE Image Synthesis for Data Augmentation

Synthetic imagery for fuzzy object detection: A comparative study

FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion

Image fusion based on generative adversarial network consistent with perception

A Generative Adversarial Network for infrared and visible image fusion using adaptive dense generator and Markovian discriminator

FISS GAN: A Generative Adversarial Network for Foggy Image Semantic Segmentation

Attention2AngioGAN: Synthesizing Fluorescein Angiography from Retinal Fundus Images using Generative Adversarial Networks

Face image-sketch synthesis via generative adversarial fusion

Fully Synthetic Videos and the Random-Background-Pasting Method for Flame Segmentation

FireNet: A Lightweight and Efficient Multi-Scenario Fire Object Detector

FSDNet-An efficient fire detection network for complex scenarios based on YOLOv3 and DenseNet

Spatial Fusion GAN for Image Synthesis

FD-GAN: Generative Adversarial Networks with Fusion-discriminator for Single Image Dehazing

Fusing Global and Local Features for Generalized AI-Synthesized Image Detection

FIRe-GAN: a novel deep learning-based infrared-visible fusion method for wildfire imagery

Single Image Desmoking via Attentive Generative Adversarial Network for Smoke Detection Process