Abstract:Image processing holds an indispensable role in various facets of our daily lives, professional undertakings, and educational pursuits, encompassing a gamut of tasks including image reconstruction, inpainting, super-resolution, colorization, and editing. In recent years, the advent of advanced models rooted in Generative Adversarial Networks (GANs) has showcased remarkable capabilities in the domain of image synthesis, catapulting the direct application of these cutting-edge models to image processing to the forefront of contemporary research. Within this context, GAN inversion, an emerging paradigm, assumes a pivotal role in the landscape of image processing tasks. This paper delves into the realm of image inversion based on the latent space of GAN models. In response to the inherent limitations of current GAN inversion methods, we introduce three innovations. Firstly, we depart from the conventional use of convolutional networks for generator implementation in existing GAN inversion techniques. Our approach employs generators entirely composed of fully connected layers, marking a significant departure from spatial convolutions and information propagation across pixels. Secondly, we leverage the distinct characteristic of generators engaged in conditional independent pixel synthesis. This feature is enhanced by fusing feature maps spanning contiguous strata of a feature pyramid network during the feature extraction process. Lastly, our framework offers a high degree of versatility, extending its applicability beyond image reconstruction to domains like image inpainting, super-resolution, and image colorization. Empirical results, based on the CelebFaces Attribute-HQ (CelebA-HQ) dataset, unequivocally demonstrate that GAN inversion, built on the principle of conditional independent pixel synthesis, yields superior reconstruction outcomes. Furthermore, it proves amenable to a plethora of tasks, including image inpainting, super-resolution, and image colorization. These advances open new vistas in image processing.

InvolutionGAN: lightweight GAN with involution for unsupervised image-to-image translation

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

SpatialGAN: Progressive Image Generation Based on Spatial Recursive Adversarial Expansion

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

Multiple GAN Inversion for Exemplar-based Image-to-Image Translation

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

Detail Fusion GAN: High-Quality Translation for Unpaired Images with GAN-based Data Augmentation

GIU-GANs: Global Information Utilization for Generative Adversarial Networks

Involution: Inverting the Inherence of Convolution for Visual Recognition

Incremental Focal Loss GANs.

iHQGAN: A Lightweight Invertible Hybrid Quantum-Classical Generative Adversarial Network for Unsupervised Image-to-Image Translation

GEN: Generative Equivariant Networks for Diverse Image-to-Image Translation.

Exploring conditional pixel-independent generation in GAN inversion for image processing

Mechanisms of Generative Image-to-Image Translation Networks

Meta-Auxiliary Network for 3D GAN Inversion

UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation

InvertAvatar: Incremental GAN Inversion for Generalized Head Avatars

Transformation GAN for Unsupervised Image Synthesis and Representation Learning

Multimodal Image-to-image Translation Between Domains with High Internal Variability

On Unsupervised Image-to-image translation and GAN stability

Unified Generative Adversarial Networks for Controllable Image-to-Image Translation