Abstract:The deployment of deep learning applications has to address the increasing privacy concerns when using private and sensitive data for training. A conventional deep learning model is prone to privacy attacks that can recover the sensitive information from either model parameters or accesses to the inference model. Recently, differential privacy (DP) has been proposed to offer provable privacy guarantees by randomizing the training process of neural networks. However, many approaches tend to provide the worst case privacy protection for model publishing, inevitably impairing the accuracy of the trained models. Thus, we present a novel private knowledge transfer strategy, where the private teacher trained on sensitive data is not publicly accessible but the student models can be released with privacy guarantees. In this paper, a three-player (teacher-student-discriminator) learning framework, Private Knowledge Distillation with Generative Adversarial Networks (PKDGAN), is proposed, where the student acquires the distilled knowledge from the teacher and is trained with the discriminator to generate similar outputs as the teacher. Moreover, a cooperative learning strategy is also suggested to support the collective training of multiple students against the discriminator when each student is with insufficient unlabelled training data. To enforce rigorous privacy guarantees, PKDGAN applies a Rényi differential privacy mechanism throughout the training process, and use it with a moment accountant technique to track the privacy cost. PKDGAN allows students to be trained with unlabelled public data and very few epochs, which avoids the exposure of training data while ensuring model performance. In the experiments, PKDGAN is found to have consistently good performance on various datasets (MNIST, SVHN, CIFAR-10, and Market-1501). When compared to prior works [1], [2], PKDGAN exhibits 5-82% accuracy loss improvement without compromising any privacy guarantee.

A Novel User Membership Leakage Attack in Collaborative Deep Learning

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networks

PKDGAN: Private Knowledge Distillation with Generative Adversarial Networks

Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks

GAN-Leaks: A Taxonomy of Membership Inference Attacks against Generative Models

Performing Co-membership Attacks Against Deep Generative Models

A Method to Facilitate Membership Inference Attacks in Deep Learning Models

Multi-level membership inference attacks in federated Learning based on active GAN

Membership Inference Attack and Defense Method in Federated Learning Based on GAN

Privacy Analysis of Deep Learning in the Wild: Membership Inference Attacks against Transfer Learning

Analyzing User-Level Privacy Attack Against Federated Learning

A Method of Information Protection for Collaborative Deep Learning under GAN Model Attack

Membership reconstruction attack in deep neural networks

MP-CLF: an Effective Model-Preserving Collaborative Deep Learning Framework for Mitigating Data Leakage under the GAN

Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning

KD‐GAN: An effective membership inference attacks defence framework

Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Models

Practical Membership Inference Attack Against Collaborative Inference in Industrial IoT

Detecting GAN-based Privacy Attack in Distributed Learning

Membership Inference Defense in Distributed Federated Learning Based on Gradient Differential Privacy and Trust Domain Division Mechanisms