Abstract:The swift evolution of machine learning has led to emergence of various definitions of privacy due to the threats it poses to privacy, including the concept of local differential privacy (LDP). Although widely embraced and utilized across numerous domains, this conventional approach to measure privacy still exhibits certain limitations, spanning from failure to prevent inferential disclosure to lack of consideration for the adversary's background knowledge. In this comprehensive study, we introduce Bayesian privacy and delve into the intricate relationship between LDP and its Bayesian counterparts, unveiling novel insights into utility-privacy trade-offs. We introduce a framework that encapsulates both attack and defense strategies, highlighting their interplay and effectiveness. The relationship between LDP and Maximum Bayesian Privacy (MBP) is first revealed, demonstrating that under uniform prior distribution, a mechanism satisfying $\xi$-LDP will satisfy $\xi$-MBP and conversely $\xi$-MBP also confers 2$\xi$-LDP. Our next theoretical contribution are anchored in the rigorous definitions and relationships between Average Bayesian Privacy (ABP) and Maximum Bayesian Privacy (MBP), encapsulated by equations $\epsilon_{p,a} \leq \frac{1}{\sqrt{2}}\sqrt{(\epsilon_{p,m} + \epsilon)\cdot(e^{\epsilon_{p,m} + \epsilon} - 1)}$. These relationships fortify our understanding of the privacy guarantees provided by various mechanisms. Our work not only lays the groundwork for future empirical exploration but also promises to facilitate the design of privacy-preserving algorithms, thereby fostering the development of trustworthy machine learning solutions.

Semantic Security: Privacy Definitions Revisited.

A Privacy Framework: Indistinguishable Privacy

A Privacy Framework

A Framework for Extracting Semantic Guarantees from Privacy

Indistinguishability: the other aspect of privacy

Indistinguishability and semantic security for quantum encryption scheme

A semantic information loss metric for privacy preserving publication

On Indistinguishability in Remote Data Integrity Checking

SOK: Privacy Definitions and Classical Mechanisms in the Local Setting

Quantifying Privacy: A Novel Entropy-Based Measure of Disclosure Risk

Privacy Protectability: An Information-theoretical Approach

On the 'Semantics' of Differential Privacy: A Bayesian Formulation

Knowledge-Assisted Privacy Preserving in Semantic Communication

Quantum Pufferfish Privacy: A Flexible Privacy Framework for Quantum Systems

Privacy Computing: Concept, Connotation and Its Research Trend

Extended Functional Representation Lemma: A Tool For Privacy, Semantic Representation, Caching, and Compression Design

Deciphering the Interplay between Local Differential Privacy, Average Bayesian Privacy, and Maximum Bayesian Privacy

Online Context-aware Streaming Data Release with Sequence Information Privacy

A Summary of Privacy-Preserving Data Publishing in the Local Setting

Secure Semantic Communications: Challenges, Approaches, and Opportunities

Online Context-aware Data Release with Sequence Information Privacy