Abstract:The Differential Privacy (DP) literature often centers on meeting privacy constraints by introducing noise to the query, typically using a pre-specified parametric distribution model with one or two degrees of freedom. However, this emphasis tends to neglect the crucial considerations of response accuracy and utility, especially in the context of categorical or discrete numerical database queries, where the parameters defining the noise distribution are finite and could be chosen optimally. This paper addresses this gap by introducing a novel framework for designing an optimal noise Probability Mass Function (PMF) tailored to discrete and finite query sets. Our approach considers the modulo summation of random noise as the DP mechanism, aiming to present a tractable solution that not only satisfies privacy constraints but also minimizes query distortion. Unlike existing approaches focused solely on meeting privacy constraints, our framework seeks to optimize the noise distribution under an arbitrary $(\epsilon, \delta)$ constraint, thereby enhancing the accuracy and utility of the response. We demonstrate that the optimal PMF can be obtained through solving a Mixed-Integer Linear Program (MILP). Additionally, closed-form solutions for the optimal PMF are provided, minimizing the probability of error for two specific cases. Numerical experiments highlight the superior performance of our proposed optimal mechanisms compared to state-of-the-art methods. This paper contributes to the DP literature by presenting a clear and systematic approach to designing noise mechanisms that not only satisfy privacy requirements but also optimize query distortion. The framework introduced here opens avenues for improved privacy-preserving database queries, offering significant enhancements in response accuracy and utility.

Securely Sampling Discrete Gaussian Noise for Multi-Party Differential Privacy

Benchmarking Secure Sampling Protocols for Differential Privacy

The Discrete Gaussian for Differential Privacy

A New Noise Generating Method Based on Gaussian Sampling for Privacy Preservation

TPMDP: Threshold Personalized Multi-party Differential Privacy via Optimal Gaussian Mechanism

Are We There Yet? Timing and Floating-Point Attacks on Differential Privacy Systems

Differential Privacy for Class-based Data: A Practical Gaussian Mechanism

CipherDM: Secure Three-Party Inference for Diffusion Model Sampling

Tractable MCMC for Private Learning with Pure and Gaussian Differential Privacy

On Differentially Private Sampling from Gaussian and Product Distributions

Efficient Noise Generation Protocols for Differentially Private Multiparty Computation

Optimum Noise Mechanism for Differentially Private Queries in Discrete Finite Sets

Less is More: Revisiting the Gaussian Mechanism for Differential Privacy

Noise Variance Optimization in Differential Privacy: A Game-Theoretic Approach Through Per-Instance Differential Privacy

Differential Privacy With Variant-Noise For Gaussian Processes Classification

Noise-Aware Statistical Inference with Differentially Private Synthetic Data

Reducing Noise Level in Differential Privacy through Matrix Masking

Rényi Differential Privacy of the Sampled Gaussian Mechanism

Differential Privacy of Noisy (S)GD under Heavy-Tailed Perturbations

Learning Numeric Optimal Differentially Private Truncated Additive Mechanisms