Abstract:With the increasing adoption of data-hungry machine learning algorithms, personal data privacy has emerged as one of the key concerns that could hinder the success of digital transformation. As such, Privacy-Preserving Machine Learning (PPML) has received much attention from both academia and industry. However, organizations are faced with the dilemma that, on the one hand, they are encouraged to share data to enhance ML performance, but on the other hand, they could potentially be breaching the relevant data privacy regulations. Practical PPML typically allows multiple participants to individually train their ML models, which are then aggregated to construct a global model in a privacy-preserving manner, e.g., based on multi-party computation or homomorphic encryption. Nevertheless, in most important applications of large-scale PPML, e.g., by aggregating clients' gradients to update a global model for federated learning, such as consumer behavior modeling of mobile application services, some participants are inevitably resource-constrained mobile devices, which may drop out of the PPML system due to their mobility nature. Therefore, the resilience of privacy-preserving aggregation has become an important problem to be tackled. In this paper, we propose a scalable privacy-preserving aggregation scheme that can tolerate dropout by participants at any time, and is secure against both semi-honest and active malicious adversaries by setting proper system parameters. By replacing communication-intensive building blocks with a seed homomorphic pseudo-random generator, and relying on the additive homomorphic property of Shamir secret sharing scheme, our scheme outperforms state-of-the-art schemes by up to 6.37$\times$ in runtime and provides a stronger dropout-resilience. The simplicity of our scheme makes it attractive both for implementation and for further improvements.

Achieving Both Valid and Secure Logistic Regression Analysis on Aggregated Data from Different Private Sources

Supporting Regularized Logistic Regression Privately and Efficiently

Privacy-preserving logistic regression with secret sharing

PrivLogit: Efficient Privacy-preserving Logistic Regression by Tailoring Numerical Optimizers

High Performance Logistic Regression for Privacy-Preserving Genome Analysis

Privacy-Preserving Multiparty Learning For Logistic Regression

Privacy-preserving two-parties logistic regression on vertically partitioned data using asynchronous gradient sharing

Privacy-preserving Logistic Regression with Improved Efficiency

Online Efficient Secure Logistic Regression based on Function Secret Sharing

Privacy-Preserving Distributed Linear Regression on High-Dimensional Data

Covariate Microaggregation for Logistic Regression: An Application for Analysis of Confidential Data

Privacy-preserving Data Aggregation Without Secure Channel: Multivariate Polynomial Evaluation

Efficient Privacy Preserving Logistic Regression for Horizontally Distributed Data

Efficient Privacy-Preserving Logistic Model With Malicious Security

Privacy-preserving model evaluation for logistic and linear regression using homomorphically encrypted genotype data

Data Aggregation without Secure Channel: How to Evaluate a Multivariate Polynomial Securely

Privacy-preserving multi-party logistic regression in cloud computing

Secure and Differentially Private Bayesian Learning on Distributed Data

SecureML: A System for Scalable Privacy-Preserving Machine Learning

Ensuring Semantic Validity in Privacy-Preserving Aggregate Statistics

Efficient Dropout-resilient Aggregation for Privacy-preserving Machine Learning