Abstract:Given a set of local sequential datasets held by multiple parties, we study the problem of publishing a synthetic dataset that preserves approximate sequentiality information of the integrated dataset while satisfying differential privacy for each local dataset. The existing solutions for publishing differentially private sequential data in the centralized setting mostly adopt tree-based approaches. Such approaches rely on different tree structures that encode sequential data's statistical information. The construction of a tree structure is normally done by recursively splitting nodes whose noisy scores (e.g., entropy or count) are larger than a given threshold. However, extending similar ideas to the multi-party setting is challenging. First, the comparison between noisy scores and a given threshold needs to be done in a distributed manner without letting the parties know the noisy scores, while satisfying differential privacy for each local dataset. Second, in the multi-party setting the large number of node splitting decisions incurs prohibitive computation costs. In addressing the above challenges, we present DPST, a distributed prediction suffix tree construction solution. In DPST, we first introduce a novel node splitting decision method that calculates the comparison result under encryption with substantially improved efficiency. Then we present a novel batch-based tree construction approach to reduce computation costs. In order to achieve high parallel performance without incurring any extra communication cost, we introduce the conjunction and slide methods to ensure that each batch contains a stable number of carefully arranged decision tasks. To further reduce communication and computation costs, we propose a prefix-based pre-pruning method to reduce the number of nodes that need to be judged whether to split by an interactive protocol. Extensive experiments on real datasets demonstrate that our DPST solution offers desirable data utility with low computation and communication costs.

A Data Synthesis Approach Based on Local Differential Privacy

PrivSyn: Differentially Private Data Synthesis

Locally differentially private high-dimensional data synthesis

An Approach for Data Publishing with Sensitive Attribute Synthesis

Local Differential Privacy for data collection and analysis

Plausible deniability for privacy-preserving data synthesis

Comparative Study of Differentially Private Data Synthesis Methods

A Summary of Privacy-Preserving Data Publishing in the Local Setting

Tabular Data Synthesis with Differential Privacy: A Survey

A Novel Privacy Preserving Method for Data Publication

ABSyn: An Accurate Differentially Private Data Synthesis Scheme With Adaptive Selection and Batch Processes

Multi-level Privacy Preserving Data Publishing

Differentially Private Data Publication with Multi-level Data Utility

Horizontally Partitioned Data Publication with Differential Privacy

Statistical Theory of Differentially Private Marginal-based Data Synthesis Algorithms

SoK: Privacy-Preserving Data Synthesis

PrivGraph: Differentially Private Graph Data Publication by Exploiting Community Information

Multi-Party Sequential Data Publishing Under Differential Privacy

Privacy protection in government data sharing: an improved LDP-based approach

(Local) Differential Privacy has NO Disparate Impact on Fairness

Differentially Private Synthetic Data: Applied Evaluations and Enhancements