Abstract:Differential privacy (DP), as a rigorous mathematical definition quantifying privacy leakage, has become a well-accepted standard for privacy protection. Combined with powerful machine learning (ML) techniques, differentially private machine learning (DPML) is increasingly important. As the most classic DPML algorithm, DP-SGD incurs a significant loss of utility, which hinders DPML's deployment in practice. Many studies have recently proposed improved algorithms based on DP-SGD to mitigate utility loss. However, these studies are isolated and cannot comprehensively measure the performance of improvements proposed in algorithms. More importantly, there is a lack of comprehensive research to compare improvements in these DPML algorithms across utility, defensive capabilities, and generalizability. We fill this gap by performing a holistic measurement of improved DPML algorithms on utility and defense capability against membership inference attacks (MIAs) on image classification tasks. We first present a taxonomy of where improvements are located in the ML life cycle. Based on our taxonomy, we jointly perform an extensive measurement study of the improved DPML algorithms, over twelve algorithms, four model architectures, four datasets, two attacks, and various privacy budget configurations. We also cover state-of-the-art label differential privacy (Label DP) algorithms in the evaluation. According to our empirical results, DP can effectively defend against MIAs, and sensitivity-bounding techniques such as per-sample gradient clipping play an important role in defense. We also explore some improvements that can maintain model utility and defend against MIAs more effectively. Experiments show that Label DP algorithms achieve less utility loss but are fragile to MIAs. ML practitioners may benefit from these evaluations to select appropriate algorithms. To support our evaluation, we implement a modular re-usable software, DPMLBench,(1) which enables sensitive data owners to deploy DPML algorithms and serves as a benchmark tool for researchers and practitioners.

A Privacy-Preserving Computation Framework for Multisource Label Propagation Services

Privacy-Preserving Multi-Label Propagation Based on Federated Learning

DPMLBench: Holistic Evaluation of Differentially Private Machine Learning

Adaptively Private Next-Token Prediction of Large Language Models

SHAPER: A General Architecture for Privacy-Preserving Primitives in Secure Machine Learning.

pMPL: A Robust Multi-Party Learning Framework with a Privileged Party

Holding Secrets Accountable: Auditing Privacy-Preserving Machine Learning

PPCL: Privacy-preserving collaborative learning for mitigating indirect information leakage

Towards Secure and Practical Machine Learning Via Secret Sharing and Random Permutation

Multi-label Learning from Privacy-Label

A Pervasive, Efficient and Private Future: Realizing Privacy-Preserving Machine Learning Through Hybrid Homomorphic Encryption

Collaboration Based Multi-Label Propagation for Fraud Detection.

Multiparty Secure Broad Learning System for Privacy Preserving

Privacy-Preserving Federated Learning via Homomorphic Adversarial Networks

SecureML: A System for Scalable Privacy-Preserving Machine Learning

Permissive Information-Flow Analysis for Large Language Models

Private, Efficient, and Accurate: Protecting Models Trained by Multi-party Learning with Differential Privacy

Pslp: Privacy-Preserving Single-Layer Perceptron Learning For E-Healthcare

Low-Latency Privacy-Preserving Deep Learning Design via Secure MPC

The Communication-Friendly Privacy-Preserving Machine Learning against Malicious Adversaries