Abstract:Differential privacy (DP) provides a provable framework for protecting individuals by customizing a random mechanism over a privacy-sensitive dataset. Deep learning models have demonstrated privacy risks in model exposure as an established learning model unintentionally records membership-level privacy leakage. Differentially private stochastic gradient descent (DP- SGD) has been proposed to safeguard training individuals by adding random Gaussian noise to gradient updates in the backpropagation. Researchers identify that DP-SGD typically causes utility loss since the injected homogeneous noise alters the gradient updates calculated at each iteration. Namely, all elements in the gradient are contaminated regardless of their importance in updating model parameters. In this work, we argue that the utility loss mainly results from the homogeneity of injected noise. Consequently, we propose a generic differential privacy framework with heterogeneous noise (DP-Hero) by defining a heterogeneous random mechanism to abstract its property. The insight of DP-Hero is to leverage the knowledge encoded in the previously trained model to guide the subsequent allocation of noise heterogeneity, thereby leveraging the statistical perturbation and achieving enhanced utility. Atop DP-Hero, we instantiate a heterogeneous version of DP-SGD, where the noise injected into gradients is heterogeneous and guided by prior-established model parameters. We conduct comprehensive experiments to verify and explain the effectiveness of the proposed DP-Hero, showing improved training accuracy compared with state-of-the-art works. Broadly, we shed light on improving the privacy-utility space by learning the noise guidance from the pre-existing leaked knowledge encoded in the previously trained model, showing a different perspective of understanding the utility-improved DP training.

Differentially-Private Deep Learning with Directional Noise

Differentially-Private Deep Learning from an Optimization Perspective.

Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks

Differentially Private Deep Learning With Dynamic Privacy Budget Allocation and Adaptive Optimization

Directional Privacy for Deep Learning

Preserving Differential Privacy in Deep Neural Networks with Relevance-Based Adaptive Noise Imposition

Differentially private stochastic gradient descent with low-noise

Rethinking Improved Privacy-Utility Trade-off with Pre-existing Knowledge for DP Training

Deep Learning with Data Privacy via Residual Perturbation

DPDR: Gradient Decomposition and Reconstruction for Differentially Private Deep Learning

Adaptive Differential Privacy Mechanism Based on Entropy Theory for Preserving Deep Neural Networks

Differentially Private Deep Learning with Iterative Gradient Descent Optimization

An Improved Privacy-Preserving Stochastic Gradient Descent Algorithm

A New Noise Generating Method Based on Gaussian Sampling for Privacy Preservation

Differential Privacy Protection over Deep Learning: an Investigation of Its Impacted Factors

GReDP: A More Robust Approach for Differential Private Training with Gradient-Preserving Noise Reduction

Accurate Differentially Private Deep Learning on the Edge

An Improved Stochastic Gradient Descent Algorithm Based on Rényi Differential Privacy

When Deep Learning Meets Differential Privacy: Privacy,Security, and More

Differentially Private Deep Learning with Smooth Sensitivity

Dynamic Differential-Privacy Preserving SGD