Abstract:ML models are ubiquitous in real world applications and are a constant focus of research. At the same time, the community has started to realize the importance of protecting the privacy of ML training data. Differential Privacy (DP) has become a gold standard for making formal statements about data anonymization. However, while some adoption of DP has happened in industry, attempts to apply DP to real world complex ML models are still few and far between. The adoption of DP is hindered by limited practical guidance of what DP protection entails, what privacy guarantees to aim for, and the difficulty of achieving good privacy-utility-computation trade-offs for ML models. Tricks for tuning and maximizing performance are scattered among papers or stored in the heads of practitioners. Furthermore, the literature seems to present conflicting evidence on how and whether to apply architectural adjustments and which components are "safe" to use with DP. This work is a self-contained guide that gives an in-depth overview of the field of DP ML and presents information about achieving the best possible DP ML model with rigorous privacy guarantees. Our target audience is both researchers and practitioners. Researchers interested in DP for ML will benefit from a clear overview of current advances and areas for improvement. We include theory-focused sections that highlight important topics such as privacy accounting and its assumptions, and convergence. For a practitioner, we provide a background in DP theory and a clear step-by-step guide for choosing an appropriate privacy definition and approach, implementing DP training, potentially updating the model architecture, and tuning hyperparameters. For both researchers and practitioners, consistently and fully reporting privacy guarantees is critical, and so we propose a set of specific best practices for stating guarantees.

Research on the Application of Deep Learning-based Differential Privacy Protection Models in Financial Big Data

Deep Learning: Differential Privacy Preservation in the Era of Big Data

Differential Privacy for Credit Risk Model

Differential privacy in deep learning: A literature survey

Deep Learning with Differential Privacy

Differential privacy in deep learning: Privacy and beyond

Analysis of Financial Risk Behavior Prediction Using Deep Learning and Big Data Algorithms

Differential Privacy in Privacy-Preserving Big Data and Learning: Challenge and Opportunity

Privacy at a Price: Exploring its Dual Impact on AI Fairness

How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy

More Than Privacy: Applying Differential Privacy in Key Areas of Artificial Intelligence

Research and Design of a Financial Intelligent Risk Control Platform Based on Big Data Analysis and Deep Machine Learning

Deep Learning with Gaussian Differential Privacy

When Deep Learning Meets Differential Privacy: Privacy,Security, and More

A survey on deep learning for financial risk prediction

A Survey on Differential Privacy with Machine Learning and Future Outlook

An Adaptive and Fast Convergent Approach to Differentially Private Deep Learning

Can we infer the presence of Differential Privacy in Deep Learning models' weights? Towards more secure Deep Learning

Research on Financial Risk Prediction and Prevention Countermeasures Based on Big Data

Differential Privacy and Machine Learning: a Survey and Review

Differentially private regression analysis with dynamic privacy allocation