Abstract:Combining data from varied sources has considerable potential for knowledge discovery: collaborating data parties can mine data in an expanded feature space, allowing them to explore a larger range of scientific questions. However, data sharing among different parties is highly restricted by legal conditions, ethical concerns, and / or data volume. Fueled by these concerns, the fields of cryptography and distributed learning have made great progress towards privacy-preserving and distributed data mining. However, practical implementations have been hampered by the limited scope or computational complexity of these methods. In this paper, we greatly extend the range of analyses available for vertically partitioned data, i.e., data collected by separate parties with different features on the same subjects. To this end, we present a novel approach for privacy-preserving generalized linear models, a fundamental and powerful framework underlying many prediction and classification procedures. We base our method on a distributed block coordinate descent algorithm to obtain parameter estimates, and we develop an extension to compute accurate standard errors without additional communication cost. We critically evaluate the information transfer for semi-honest collaborators and show that our protocol is secure against data reconstruction. Through both simulated and real-world examples we illustrate the functionality of our proposed algorithm. Without leaking information, our method performs as well on vertically partitioned data as existing methods on combined data -- all within mere minutes of computation time. We conclude that our method is a viable approach for vertically partitioned data analysis with a wide range of real-world applications.

Secure multi-party linear regression at plaintext speed

High Performance Logistic Regression for Privacy-Preserving Genome Analysis

Privacy-Preserving Distributed Linear Regression on High-Dimensional Data

Privacy Preserving PCA for Multiparty Modeling

SecureML: A System for Scalable Privacy-Preserving Machine Learning

Scalable Privacy-Preserving Distributed Learning

PrivLogit: Efficient Privacy-preserving Logistic Regression by Tailoring Numerical Optimizers

Privacy-Preserving Generalized Linear Models using Distributed Block Coordinate Descent

CodedPrivateML: A Fast and Privacy-Preserving Framework for Distributed Machine Learning

Privacy-preserving model evaluation for logistic and linear regression using homomorphically encrypted genotype data

Secure Multi-pArty Computation Grid LOgistic REgression (SMAC-GLORE)

Efficient Privacy Preserving Logistic Regression for Horizontally Distributed Data

Towards Vertical Privacy-Preserving Symbolic Regression via Secure Multiparty Computation

Supporting Regularized Logistic Regression Privately and Efficiently

Online Efficient Secure Logistic Regression based on Function Secret Sharing

Privacy-Preserving Logistic Regression Training on Large Datasets

Privacy-preserving semi-parallel logistic regression training with fully homomorphic encryption

Iterative Sketching for Secure Coded Regression

Privacy-preserving two-parties logistic regression on vertically partitioned data using asynchronous gradient sharing

Distributed Differentially Private Data Analytics via Secure Sketching