Abstract:Machine learning (ML) is increasingly being adopted in a wide variety of application domains. Usually, a well-performing ML model relies on a large volume of training data and high-powered computational resources. Such a need for and the use of huge volumes of data raise serious privacy concerns because of the potential risks of leakage of highly privacy-sensitive information; further, the evolving regulatory environments that increasingly restrict access to and use of privacy-sensitive data add significant challenges to fully benefiting from the power of ML for data-driven applications. A trained ML model may also be vulnerable to adversarial attacks such as membership, attribute, or property inference attacks and model inversion attacks. Hence, well-designed privacy-preserving ML (PPML) solutions are critically needed for many emerging applications. Increasingly, significant research efforts from both academia and industry can be seen in PPML areas that aim toward integrating privacy-preserving techniques into ML pipeline or specific algorithms, or designing various PPML architectures. In particular, existing PPML research cross-cut ML, systems and applications design, as well as security and privacy areas; hence, there is a critical need to understand state-of-the-art research, related challenges and a research roadmap for future research in PPML area. In this paper, we systematically review and summarize existing privacy-preserving approaches and propose a Phase, Guarantee, and Utility (PGU) triad based model to understand and guide the evaluation of various PPML solutions by decomposing their privacy-preserving functionalities. We discuss the unique characteristics and challenges of PPML and outline possible research directions that leverage as well as benefit multiple research communities such as ML, distributed systems, security and privacy.

A comprehensive survey and taxonomy on privacy-preserving deep learning

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Privacy-Preserving Deep Learning on Machine Learning as a Service—a Comprehensive Survey

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Deep Learning: Differential Privacy Preservation in the Era of Big Data

State-of-the-Art Approaches to Enhancing Privacy Preservation of Machine Learning Datasets: A Survey

Rethinking Privacy Preserving Deep Learning: How to Evaluate and Thwart Privacy Attacks

Privacy-Preserving Machine Learning: Methods, Challenges and Directions

How to keep text private? A systematic review of deep learning methods for privacy-preserving natural language processing

A Survey of Deep Learning Architectures for Privacy-Preserving Machine Learning With Fully Homomorphic Encryption

Security and Privacy Issues in Deep Learning: A Brief Review

Distributed Layer-Partitioned Training for Privacy-Preserved Deep Learning

Privacy Threats and Protection in Machine Learning

A survey on privacy inference attacks and defenses in cloud-based Deep Neural Network

Privacy Inference Attacks and Defenses in Cloud-based Deep Neural Network: A Survey

A Survey of Machine and Deep Learning Methods for Privacy Protection in the Internet of Things

A Comprehensive Review on Deep Learning Algorithms: Security and Privacy Issues

The privacy-explainability trade-off: unraveling the impacts of differential privacy and federated learning on attribution methods

Differential Privacy for Deep and Federated Learning: A Survey

When Machine Learning Meets Privacy: A Survey and Outlook