Abstract:Differential privacy (DP) has been widely explored in academia recently but less so in industry possibly due to its strong privacy guarantee. This paper makes the first attempt to implement three basic DP architectures in the deployed telecommunication (telco) big data platform for data mining applications. We find that all DP architectures have less than 5% loss of prediction accuracy when the weak privacy guarantee is adopted (e.g., privacy budget parameter ε ≥ 3). However, when the strong privacy guarantee is assumed (e.g., privacy budget parameter ε ≤ 0:1), all DP architectures lead to 15% ~ 30% accuracy loss, which implies that real-word industrial data mining systems cannot work well under such a strong privacy guarantee recommended by previous research works. Among the three basic DP architectures, the Hybridized DM (Data Mining) and DB (Database) architecture performs the best because of its complicated privacy protection design for the specific data mining algorithm. Through extensive experiments on big data, we also observe that the accuracy loss increases by increasing the variety of features, but decreases by increasing the volume of training data. Therefore, to make DP practically usable in large-scale industrial systems, our observations suggest that we may explore three possible research directions in future: (1) Relaxing the privacy guarantee (e.g., increasing privacy budget ε) and studying its effectiveness on specific industrial applications; (2) Designing specific privacy scheme for specific data mining algorithms; and (3) Using large volume of data but with low variety for training the classification models.

Cohere: Managing Differential Privacy in Large Scale Systems

NetDP: In-Network Differential Privacy for Large-Scale Data Processing

DPShield: Optimizing Differential Privacy for High-Utility Data Analysis in Sensitive Domains

Privacy accounting $\varepsilon$conomics: Improving differential privacy composition via a posteriori bounds

Do I Get the Privacy I Need? Benchmarking Utility in Differential Privacy Libraries

Advancing Differential Privacy: Where We Are Now and Future Directions for Real-World Deployment

A Programming Framework for Differential Privacy with Accuracy Concentration Bounds

Federated Experiment Design under Distributed Differential Privacy

A Differentially Private Framework for the Dynamic Heterogeneous Redundant Architecture System in Cyberspace

Mitigating Leakage from Data Dependent Communications in Decentralized Computing using Differential Privacy

Just Keep Your Concerns Private: Guaranteeing Heterogeneous Privacy and Achieving High Availability for ERM Algorithms

Privacy Preserving Collaborative Computing: Heterogeneous Privacy Guarantee and Efficient Incentive Mechanism

Scalable Differential Privacy Mechanisms for Real-Time Machine Learning Applications

Differential Privacy in Telco Big Data Platform

Differential Privacy in Privacy-Preserving Big Data and Learning: Challenge and Opportunity

Centering Policy and Practice: Research Gaps around Usable Differential Privacy

Elephants Do Not Forget: Differential Privacy with State Continuity for Privacy Budget

Meeting Utility Constraints in Differential Privacy: A Privacy-Boosting Approach

Integrating Differential Privacy and Contextual Integrity

Improving Privacy and Utility in Aggregate Data: A Hybrid Approach

Wasserstein Differential Privacy