Abstract:Model quantization is a promising approach to compress deep neural networks and accelerate inference, making it possible to be deployed on mobile and edge devices. To retain the high performance of full-precision models, most existing quantization methods focus on fine-tuning quantized model by assuming training datasets are accessible. However, this assumption sometimes is not satisfied in real situations due to data privacy and security issues, thereby making these quantization methods not applicable. To achieve zero-short model quantization without accessing training data, a tiny number of quantization methods adopt either post-training quantization or batch normalization statistics-guided data generation for fine-tuning. However, both of them inevitably suffer from low performance, since the former is a little too empirical and lacks training support for ultra-low precision quantization, while the latter could not fully restore the peculiarities of original data and is often low efficient for diverse data generation. To address the above issues, we propose a zero-shot adversarial quantization (ZAQ) framework, facilitating effective discrepancy estimation and knowledge transfer from a full-precision model to its quantized model. This is achieved by a novel two-level discrepancy modeling to drive a generator to synthesize informative and diverse data examples to optimize the quantized model in an adversarial learning fashion. We conduct extensive experiments on three fundamental vision tasks, demonstrating the superiority of ZAQ over the strong zero-shot baselines and validating the effectiveness of its main components. Code is available at <<a class="link-external link-https" href="https://git.io/Jqc0y>" rel="external noopener nofollow">this https URL</a>.

Not All Tasks Are Born Equal: Understanding Zero-Shot Generalization

ZeroPrompt: Scaling Prompt-Based Pretraining to 1, 000 Tasks Improves Zero-Shot Generalization.

Zero-Shot Generalization during Instruction Tuning: Insights from Similarity and Granularity

Zero-Shot Visual Question Answering Using Knowledge Graph

Meta-Transfer Networks for Zero-Shot Learning

To Boost Zero-Shot Generalization for Embodied Reasoning With Vision-Language Pre-Training

Zero-shot Text-to-SQL Learning with Auxiliary Task

Explainable Zero-Shot Learning Via Attentive Graph Convolutional Network And Knowledge Graphs

Structure Pre-training and Prompt Tuning for Knowledge Graph Transfer

Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Survey

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

A Universal Discriminator for Zero-Shot Generalization

Transfer Increment for Generalized Zero-Shot Learning

Worst-Case-Aware Curriculum Learning for Zero and Few Shot Transfer

Improving Zero-Shot Cross-lingual Transfer for Multilingual Question Answering over Knowledge Graph

Enabling Natural Zero-Shot Prompting on Encoder Models via Statement-Tuning

Zero-shot Adversarial Quantization

Toward Zero-Shot Instruction Following

Modularized Zero-shot VQA with Pre-trained Models

Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning

Instance-Specific Model Perturbation Improves Generalized Zero-Shot Learning