Abstract:Machine learning (ML) is increasingly being adopted in a wide variety of application domains. Usually, a well-performing ML model relies on a large volume of training data and high-powered computational resources. Such a need for and the use of huge volumes of data raise serious privacy concerns because of the potential risks of leakage of highly privacy-sensitive information; further, the evolving regulatory environments that increasingly restrict access to and use of privacy-sensitive data add significant challenges to fully benefiting from the power of ML for data-driven applications. A trained ML model may also be vulnerable to adversarial attacks such as membership, attribute, or property inference attacks and model inversion attacks. Hence, well-designed privacy-preserving ML (PPML) solutions are critically needed for many emerging applications. Increasingly, significant research efforts from both academia and industry can be seen in PPML areas that aim toward integrating privacy-preserving techniques into ML pipeline or specific algorithms, or designing various PPML architectures. In particular, existing PPML research cross-cut ML, systems and applications design, as well as security and privacy areas; hence, there is a critical need to understand state-of-the-art research, related challenges and a research roadmap for future research in PPML area. In this paper, we systematically review and summarize existing privacy-preserving approaches and propose a Phase, Guarantee, and Utility (PGU) triad based model to understand and guide the evaluation of various PPML solutions by decomposing their privacy-preserving functionalities. We discuss the unique characteristics and challenges of PPML and outline possible research directions that leverage as well as benefit multiple research communities such as ML, distributed systems, security and privacy.

Guest Editorial: Special Issue on Security and Privacy in Machine Learning

Machine Learning Security and Privacy

Machine Learning: the Cyber-Security, Privacy, and Public Safety Opportunities and Challenges for Emerging Applications

Guest Editorial IEEE Transactions on Emerging Topics in Computing Special Section on Advances in Emerging Privacy-Preserving Computing

When Machine Learning Meets Privacy: A Survey and Outlook

Privacy Threats and Protection in Machine Learning

Security and Privacy in Machine Learning for Health Systems: Strategies and Challenges

Security Issues and Their Countermeasuring Techniques of Machine Learning: A Survey

Towards the Science of Security and Privacy in Machine Learning

Special Issue on Recent Advances in Machine Learning and Computational Intelligence

When Machine Learning Meets Security Issues: A Survey

On the protection of private information in machine learning systems: Two recent approches

On the Protection of Private Information in Machine Learning Systems: Two Recent Approaches

Preface of Special Issue on Artificial Intelligence: the Security & Privacy Opportunities and Challenges for Emerging Applications

Cryptographic Approaches for Privacy-Preserving Machine Learning

Data-Driven Security Analysis of Machine Learning Systems

Guest Editorial Special Issue on Security and Privacy Protection for Big Data and IoT.

Privacy-Preserving Machine Learning: Methods, Challenges and Directions

Privacy Preserving Machine Learning: Threats and Solutions

Security and Machine Learning in the Real World

Secure Machine Learning, a Brief Overview