Abstract:Latent Dirichlet allocation (LDA) is a topic model widely used for discovering hidden semantics in massive text corpora. Collapsed Gibbs sampling (CGS), as a widely-used algorithm for learning the parameters of LDA, has the risk of privacy leakage. Specifically, word count statistics and updates of latent topics in CGS, which are essential for parameter estimation, could be employed by adversaries to conduct effective membership inference attacks (MIAs). Till now, there are two kinds of methods exploited in CGS to defend against MIAs: adding noise to word count statistics and utilizing inherent privacy. These two kinds of methods have their respective limitations. Noise sampled from the Laplacian distribution sometimes produces negative word count statistics, which render terrible parameter estimation in CGS. Utilizing inherent privacy could only provide weak guaranteed privacy when defending against MIAs. It is promising to propose an effective framework to obtain accurate parameter estimations with guaranteed differential privacy. The key issue of obtaining accurate parameter estimations when introducing differential privacy in CGS is making good use of the privacy budget such that a precise noise scale is derived. It is the first time that Rényi differential privacy (RDP) has been introduced into CGS and we propose RDP-LDA, an effective framework for analyzing the privacy loss of any differentially private CGS. RDP-LDA could be used to derive a tighter upper bound of privacy loss than the overestimated results of existing differentially private CGS obtained by ε -DP. In RDP-LDA, we propose a novel truncated-Gaussian mechanism that keeps word count statistics non-negative. And we propose distribution perturbation which could provide more rigorous guaranteed privacy than utilizing inherent privacy. Experiments validate that our proposed methods produce more accurate parameter estimation under the JS-divergence metric and obtain lower precision and recall when defending against MIAs.

Defending against Reconstruction Attacks with Rényi Differential Privacy

Bounding Reconstruction Attack Success of Adversaries Without Data Priors

Bounding data reconstruction attacks with the hypothesis testing interpretation of differential privacy

Improving Parameter Estimation and Defensive Ability of Latent Dirichlet Allocation Model Training under Rényi Differential Privacy

Protection Against Reconstruction and Its Applications in Private Federated Learning

Data Reconstruction Attacks and Defenses: A Systematic Evaluation

Efficient and Private Marginal Reconstruction with Local Non-Negativity

On the Rényi Differential Privacy of the Shuffle Model

Bounding Training Data Reconstruction in DP-SGD

Reconstruction of Differentially Private Text Sanitization via Large Language Models

Hyperparameter Tuning with Renyi Differential Privacy

On Rényi Differential Privacy in Statistics-Based Synthetic Data Generation

Analyzing Privacy Leakage in Machine Learning via Multiple Hypothesis Testing: A Lesson From Fano

Learning Differentially Private Recurrent Language Models

Reconstruction Attacks on Machine Unlearning: Simple Models are Vulnerable

How reparametrization trick broke differentially-private text representation learning

Exploring the Security Boundary of Data Reconstruction via Neuron Exclusivity Analysis

Unveiling the Vulnerability of Private Fine-Tuning in Split-Based Frameworks for Large Language Models: A Bidirectionally Enhanced Attack

One Parameter Defense -- Defending against Data Inference Attacks via Differential Privacy

Reconstruction Attack on Differential Private Trajectory Protection Mechanisms

Renyi Differential Privacy in the Shuffle Model: Enhanced Amplification Bounds