Abstract:Combining data from varied sources has considerable potential for knowledge discovery: collaborating data parties can mine data in an expanded feature space, allowing them to explore a larger range of scientific questions. However, data sharing among different parties is highly restricted by legal conditions, ethical concerns, and / or data volume. Fueled by these concerns, the fields of cryptography and distributed learning have made great progress towards privacy-preserving and distributed data mining. However, practical implementations have been hampered by the limited scope or computational complexity of these methods. In this paper, we greatly extend the range of analyses available for vertically partitioned data, i.e., data collected by separate parties with different features on the same subjects. To this end, we present a novel approach for privacy-preserving generalized linear models, a fundamental and powerful framework underlying many prediction and classification procedures. We base our method on a distributed block coordinate descent algorithm to obtain parameter estimates, and we develop an extension to compute accurate standard errors without additional communication cost. We critically evaluate the information transfer for semi-honest collaborators and show that our protocol is secure against data reconstruction. Through both simulated and real-world examples we illustrate the functionality of our proposed algorithm. Without leaking information, our method performs as well on vertically partitioned data as existing methods on combined data -- all within mere minutes of computation time. We conclude that our method is a viable approach for vertically partitioned data analysis with a wide range of real-world applications.

Privacy Preserving PCA for Multiparty Modeling

Scalable and Privacy-Preserving Federated Principal Component Analysis

PRICURE: Privacy-Preserving Collaborative Inference in a Multi-Party Setting

Multiparty Secure Broad Learning System for Privacy Preserving

SHAPER: A General Architecture for Privacy-Preserving Primitives in Secure Machine Learning.

MPCPA: Multi-Center Privacy Computing with Predictions Aggregation Based on Denoising Diffusion Probabilistic Model

Multicenter Privacy-Preserving Cox Analysis Based on Homomorphic Encryption

Iprivjoin: an ID-Private Data Join Framework for Privacy-Preserving Machine Learning.

Privacy-preserving multi-party logistic regression in cloud computing

Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing

Multi-party Secure Broad Learning System for Privacy Preserving

Practical Two-party Privacy-preserving Neural Network Based on Secret Sharing

Privacy-Preserving Multiparty Learning For Logistic Regression

Analog Multi-Party Computing: Locally Differential Private Protocols for Collaborative Computations

PrivPy

PPMLAC: High Performance Chipset Architecture for Secure Multi-Party Computation

PPMLAC

Privacy-Preserving Generalized Linear Models using Distributed Block Coordinate Descent

Privacy-Preserving Distributed Linear Regression on High-Dimensional Data

Privacy preserving distributed data mining based on secure multi-party computation

PCAL: A Privacy-preserving Intelligent Credit Risk Modeling Framework Based on Adversarial Learning