Abstract:The problem of privacy-preserving data analysis has a long history spanning multiple disciplines. As electronic data about individuals becomes increasingly detailed, and as technology enables ever more powerful collection and curation of these data, the need increases for a robust, meaningful, and mathematically rigorous definition of privacy, together with a computationally rich class of algorithms that satisfy this definition. Differential Privacy is such a definition. After motivating and discussing the meaning of differential privacy, the preponderance of this monograph is devoted to fundamental techniques for achieving differential privacy, and application of these techniques in creative combinations, using the query-release problem as an ongoing example. A key point is that, by rethinking the computational goal, one can often obtain far better results than would be achieved by methodically replacing each step of a non-private computation with a differentially private implementation. Despite some astonishingly powerful computational results, there are still fundamental limitations — not just on what can be achieved with differential privacy but on what can be achieved with any method that protects against a complete breakdown in privacy. Virtually all the algorithms discussed herein maintain differential privacy against adversaries of arbitrary computational power. Certain algorithms are computationally intensive, others are efficient. Computational complexity for the adversary and the algorithm are both discussed. We then turn from fundamentals to applications other than queryrelease, discussing differentially private methods for mechanism design and machine learning. The vast majority of the literature on differentially private algorithms considers a single, static, database that is subject to many analyses. Differential privacy in other models, including distributed databases and computations on data streams is discussed. Finally, we note that this work is meant as a thorough introduction to the problems and techniques of differential privacy, but is not intended to be an exhaustive survey — there is by now a vast amount of work in differential privacy, and we can cover only a small portion of it.

Adore: Differentially Oblivious Relational Database Operators

Round-Efficient Oblivious Database Manipulation

Differentially Private SQL with Bounded User Contribution

The Optimization Of The Range-Count Queries In Differential Privacy

Efficient Oblivious Database Joins

$\mathcal{E}\text{psolute}$: Efficiently Querying Databases While Providing Differential Privacy

DProvDB: Differentially Private Query Processing with Multi-Analyst Provenance

Query Optimization for Differentially Private Data Management Systems.

Elephants Do Not Forget: Differential Privacy with State Continuity for Privacy Budget

Convex Optimization for Linear Query Processing under Approximate Differential Privacy

PrivLava: Synthesizing Relational Data with Foreign Keys under Differential Privacy

Opca: Enabling Optimistic Concurrent Access for Multiple Users in Oblivious Data Storage

A Workload Division Differential Privacy Algorithm to Improve the Accuracy for Linear Computations

Constrained Differential Privacy for Count Data

Optimizing Batch Linear Queries under Exact and Approximate Differential Privacy

The Algorithmic Foundations of Differential Privacy

Differential Privacy Enhanced Dynamic Searchable Symmetric Encryption for Cloud Environments.

Recursive Mechanism: Towards Node Differential Privacy and Unrestricted Joins [full Version, Draft 0.1]

Differentially Oblivious Data Analysis with Intel SGX: Design, Optimization, and Evaluation

Reconstruction Attacks on Aggressive Relaxations of Differential Privacy

PEO-Store: Delegation-Proof based Oblivious Storage with Secure Redundancy Elimination