Abstract:Generative Adversarial Networks (GANs) have shown remarkable success in modeling complex data distributions for image-to-image translation. Still, their high computational demands prohibit their deployment in practical scenarios like edge devices. Existing GAN compression methods mainly rely on knowledge distillation or convolutional classifiers' pruning techniques. Thus, they neglect the critical characteristic of GANs: their local density structure over their learned manifold. Accordingly, we approach GAN compression from a new perspective by explicitly encouraging the pruned model to preserve the density structure of the original parameter-heavy model on its learned manifold. We facilitate this objective for the pruned model by partitioning the learned manifold of the original generator into local neighborhoods around its generated samples. Then, we propose a novel pruning objective to regularize the pruned model to preserve the local density structure over each neighborhood, resembling the kernel density estimation method. Also, we develop a collaborative pruning scheme in which the discriminator and generator are pruned by two pruning agents. We design the agents to capture interactions between the generator and discriminator by exchanging their peer's feedback when determining corresponding models' architectures. Thanks to such a design, our pruning method can efficiently find performant sub-networks and can maintain the balance between the generator and discriminator more effectively compared to baselines during pruning, thereby showing more stable pruning dynamics. Our experiments on image translation GAN models, Pix2Pix and CycleGAN, with various benchmark datasets and architectures demonstrate our method's effectiveness.

Enhancing GAN Compression by Image Probability Distribution Distillation.

Discriminator-Cooperated Feature Map Distillation for GAN Compression

A GAN-based Tunable Image Compression System

Compressing GANs using Knowledge Distillation

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

DGL-GAN: Discriminator-Guided GAN Compression

DGL-GAN: Discriminator Guided Learning for GAN Compression

PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression

Research on Knowledge Distillation of Generative Adversarial Networks

AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks

Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme

Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold

Distilling Diffusion Models into Conditional GANs

Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation

Exploring Content Relationships for Distilling Efficient GANs

Learning Efficient GANs Using Differentiable Masks and Co-Attention Distillation

Learning Efficient GANs using Differentiable Masks and co-Attention Distillation.

Improving GAN Training via Feature Space Shrinkage

Nickel and Diming Your GAN: A Dual-Method Approach to Enhancing GAN Efficiency via Knowledge Distillation

Dist-GAN: An Improved GAN using Distance Constraints