Abstract:Generative Adversarial Networks (GANs) have shown remarkable success in modeling complex data distributions for image-to-image translation. Still, their high computational demands prohibit their deployment in practical scenarios like edge devices. Existing GAN compression methods mainly rely on knowledge distillation or convolutional classifiers' pruning techniques. Thus, they neglect the critical characteristic of GANs: their local density structure over their learned manifold. Accordingly, we approach GAN compression from a new perspective by explicitly encouraging the pruned model to preserve the density structure of the original parameter-heavy model on its learned manifold. We facilitate this objective for the pruned model by partitioning the learned manifold of the original generator into local neighborhoods around its generated samples. Then, we propose a novel pruning objective to regularize the pruned model to preserve the local density structure over each neighborhood, resembling the kernel density estimation method. Also, we develop a collaborative pruning scheme in which the discriminator and generator are pruned by two pruning agents. We design the agents to capture interactions between the generator and discriminator by exchanging their peer's feedback when determining corresponding models' architectures. Thanks to such a design, our pruning method can efficiently find performant sub-networks and can maintain the balance between the generator and discriminator more effectively compared to baselines during pruning, thereby showing more stable pruning dynamics. Our experiments on image translation GAN models, Pix2Pix and CycleGAN, with various benchmark datasets and architectures demonstrate our method's effectiveness.

Learning Efficient GANs Using Differentiable Masks and Co-Attention Distillation

Learning Efficient GANs using Differentiable Masks and co-Attention Distillation.

Learning Efficient GANs for Image Translation Via Differentiable Masks and Co-Attention Distillation

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

Discriminator-Cooperated Feature Map Distillation for GAN Compression

AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks

Differentiable Augmentation for Data-Efficient GAN Training

Training Generative Adversarial Networks in One Stage

Distilling Portable Generative Adversarial Networks for Image Translation.

E$^{2}$GAN: Efficient Training of Efficient GANs for Image-to-Image Translation

DGL-GAN: Discriminator-Guided GAN Compression

Compressing GANs using Knowledge Distillation

GAN Slimming: All-in-One GAN Compression by A Unified Optimization Framework

DGL-GAN: Discriminator Guided Learning for GAN Compression

A New Distributed Method for Training Generative Adversarial Networks

Nickel and Diming Your GAN: A Dual-Method Approach to Enhancing GAN Efficiency via Knowledge Distillation

PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression

Adjustable Model Compression using Multiple Genetic Algorithms

MFAGAN: A Compression Framework for Memory-Efficient On-Device Super-Resolution GAN

Self-Supervised GAN Compression.

Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold