Abstract:Over the past few years, providers such as Google, Microsoft, and Amazon have started to provide customers with access to software interfaces allowing them to easily embed machine learning tasks into their applications. Overall, organizations can now use Machine Learning as a Service (MLaaS) engines to outsource complex tasks, e.g., training classifiers, performing predictions, clustering, etc. They can also let others query models trained on their data. Naturally, this approach can also be used (and is often advocated) in other contexts, including government collaborations, citizen science projects, and business-to-business partnerships. However, if malicious users were able to recover data used to train these models, the resulting information leakage would create serious issues. Likewise, if the inner parameters of the model are considered proprietary information, then access to the model should not allow an adversary to learn such parameters. In this document, we set to review privacy challenges in this space, providing a systematic review of the relevant research literature, also exploring possible countermeasures. More specifically, we provide ample background information on relevant concepts around machine learning and privacy. Then, we discuss possible adversarial models and settings, cover a wide range of attacks that relate to private and/or sensitive information leakage, and review recent results attempting to defend against such attacks. Finally, we conclude with a list of open problems that require more work, including the need for better evaluations, more targeted defenses, and the study of the relation to policy and data protection efforts.

Data Privacy and Trustworthy Machine Learning

Trustworthy machine learning in the context of security and privacy

Privacy Preserving Machine Learning: Threats and Solutions

An Overview of Privacy in Machine Learning

Machine Learning in Health Care: Ethical Considerations Tied to Privacy, Interpretability, and Bias

Machine Learning with Privacy by Knowledge Aggregation and Transfer

Privacy Threats and Protection in Machine Learning

Trustworthy Machine Learning under Social and Adversarial Data Sources

Towards the Science of Security and Privacy in Machine Learning

Privacy at a Price: Exploring its Dual Impact on AI Fairness

Privacy Implications of Explainable AI in Data-Driven Systems

A Review of Speech-centric Trustworthy Machine Learning: Privacy, Safety, and Fairness

Technologies for Trustworthy Machine Learning: A Survey in a Socio-Technical Context

On the Protection of Private Information in Machine Learning Systems: Two Recent Approaches

On the protection of private information in machine learning systems: Two recent approches

Trustworthy Machine Learning: Robustness, Generalization, and Interpretability.

Machine learning in medicine: Addressing ethical challenges

The Impact of Machine Learning Algorithms and Big Data on Privacy in Data Collection and Analysis

Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Models

A Novel Review of Stability Techniques for Improved Privacy-Preserving Machine Learning

When Machine Learning Meets Privacy: A Survey and Outlook