Abstract:Machine Learning (ML), addresses a multitude of complex issues in multiple disciplines, including social sciences, finance, and medical research. ML models require substantial computing power and are only as powerful as the data utilized. Due to the high computational cost of ML methods, data scientists frequently use Machine Learning-as-a-Service (MLaaS) to outsource computation to external servers. However, when working with private information, like financial data or health records, outsourcing the computation might result in privacy issues. Recent advances in Privacy-Preserving Techniques (PPTs) have enabled ML training and inference over protected data through the use of Privacy-Preserving Machine Learning (PPML). However, these techniques are still at a preliminary stage and their application in real-world situations is demanding. In order to comprehend the discrepancy between theoretical research suggestions and actual applications, this work examines the past and present of PPML, focusing on Homomorphic Encryption (HE) and Secure Multi-party Computation (SMPC) applied to ML. This work primarily focuses on the ML model's training phase, where maintaining user data privacy is of utmost importance. We provide a solid theoretical background that eases the understanding of current approaches and their limitations. We also provide some preliminaries of SMPC, HE, and ML. In addition, we present a systemization of knowledge of the most recent PPML frameworks for model training and provide a comprehensive comparison in terms of the unique properties and performances on standard benchmarks. Also, we reproduce the results for some of the surveyed papers and examine at what level existing works in the field provide support for open science. We believe our work serves as a valuable contribution by raising awareness about the current gap between theoretical advancements and real-world applications in PPML, specifically regarding open-source availability, reproducibility, and usability.

PPMLP 2020: Workshop on Privacy-Preserving Machine Learning in Practice

Privacy-Preserving Machine Learning: Methods, Challenges and Directions

State-of-the-Art Approaches to Enhancing Privacy Preservation of Machine Learning Datasets: A Survey

Poster: Nebula: an Industrial-purpose Privacy-preserving Machine Learning System

When Machine Learning Meets Privacy: A Survey and Outlook

Privacy-Preserving Deep Learning on Machine Learning as a Service—a Comprehensive Survey

The Communication-Friendly Privacy-Preserving Machine Learning against Malicious Adversaries

Wildest Dreams: Reproducible Research in Privacy-preserving Neural Network Training

SoK: Wildest Dreams: Reproducible Research in Privacy-preserving Neural Network Training

Preserving Data Privacy in Machine Learning Systems

Privacy Threats and Protection in Machine Learning

SoK: Training Machine Learning Models over Multiple Sources with Privacy Preservation

Iprivjoin: an ID-Private Data Join Framework for Privacy-Preserving Machine Learning.

The Impact of Machine Learning Algorithms and Big Data on Privacy in Data Collection and Analysis

Privacy-Preserving Customer Support: A Framework for Secure and Scalable Interactions

Privacy-preserving machine learning for healthcare: open challenges and future perspectives

An Overview of Privacy in Machine Learning

PPML-Omics: A privacy-preserving federated machine learning method protects patients' privacy in omic data

Investigating privacy-preserving machine learning for healthcare data sharing through federated learning

Local Privacy-preserving Mechanisms and Applications in Machine Learning

Privacy-Preserving Machine Learning Based Data Analytics on Edge Devices