Abstract:Generative adversarial networks (GANs) have emerged as a powerful solution for generating synthetic data when the availability of large, labeled training datasets is limited or costly in large-scale machine learning systems. Recent advancements in GAN models have extended their applications across diverse domains, including medicine, robotics, and content synthesis. These advanced GAN models have gained recognition for their excellent accuracy by scaling the model. However, existing accelerators face scalability challenges when dealing with large-scale GAN models. As the size of GAN models increases, the demand for computation and communication resources during inference continues to grow. To address this scalability issue, this article proposes Chiplet-GAN, a chiplet-based accelerator design for GAN inference. Chiplet-GAN enables scalability by adding more chiplets to the system, thereby supporting the scaling of computation capabilities. To handle the increasing communication demand as the system and model scale, a novel interconnection network with adaptive topology and passive/active network links is developed to provide adequate communication support for Chiplet-GAN. Coupled with workload partition and allocation algorithms, Chiplet-GAN reduces execution time and energy consumption for GAN inference workloads as both model and chiplet-system scales. Evaluation results using various GAN models show the effectiveness of Chiplet-GAN. On average, compared to GANAX, SpAtten, and Simba, the Chiplet-GAN reduces execution time and energy consumption by 34% and 21%, respectively. Furthermore, as the system scales for large-scale GAN model inference, Chiplet-GAN achieves reductions in execution time of up to 63% compared to the Simba, a chiplet-based accelerator.

Nickel and Diming Your GAN: A Dual-Method Approach to Enhancing GAN Efficiency via Knowledge Distillation

Compressing GANs using Knowledge Distillation

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

DGL-GAN: Discriminator-Guided GAN Compression

DGL-GAN: Discriminator Guided Learning for GAN Compression

AutoGAN-Distiller: Searching to Compress Generative Adversarial Networks

Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme

Discriminator-Cooperated Feature Map Distillation for GAN Compression

Learning Efficient GANs Using Differentiable Masks and Co-Attention Distillation

Learning Efficient GANs using Differentiable Masks and co-Attention Distillation.

GAN Slimming: All-in-One GAN Compression by A Unified Optimization Framework

CoroNetGAN: Controlled Pruning of GANs via Hypernetworks

Enhancing GAN Compression by Image Probability Distribution Distillation.

Self-Supervised GAN Compression.

Self-Supervised GAN Compression

A survey on GAN acceleration using memory compression techniques

Information-Theoretic GAN Compression with Variational Energy-based Model

Chiplet-GAN: Chiplet-Based Accelerator Design for Scalable Generative Adversarial Network Inference

Simple Yet Effective Way for Improving the Performance of GAN

Learning Efficient GANs for Image Translation Via Differentiable Masks and Co-Attention Distillation

Differentiable Augmentation for Data-Efficient GAN Training