Abstract:Combining data from varied sources has considerable potential for knowledge discovery: collaborating data parties can mine data in an expanded feature space, allowing them to explore a larger range of scientific questions. However, data sharing among different parties is highly restricted by legal conditions, ethical concerns, and / or data volume. Fueled by these concerns, the fields of cryptography and distributed learning have made great progress towards privacy-preserving and distributed data mining. However, practical implementations have been hampered by the limited scope or computational complexity of these methods. In this paper, we greatly extend the range of analyses available for vertically partitioned data, i.e., data collected by separate parties with different features on the same subjects. To this end, we present a novel approach for privacy-preserving generalized linear models, a fundamental and powerful framework underlying many prediction and classification procedures. We base our method on a distributed block coordinate descent algorithm to obtain parameter estimates, and we develop an extension to compute accurate standard errors without additional communication cost. We critically evaluate the information transfer for semi-honest collaborators and show that our protocol is secure against data reconstruction. Through both simulated and real-world examples we illustrate the functionality of our proposed algorithm. Without leaking information, our method performs as well on vertically partitioned data as existing methods on combined data -- all within mere minutes of computation time. We conclude that our method is a viable approach for vertically partitioned data analysis with a wide range of real-world applications.

A General Framework for Privacy-Preserving Distributed Greedy Algorithm.

A Framework for Optimization in Big Data: Privacy-Preserving Multi-agent Greedy Algorithm

Privacy Preserving Distributed DBSCAN Clustering

A Privacy Framework

A Privacy Framework: Indistinguishable Privacy

Privacy-Preserving Distributed Online Optimization Over Unbalanced Digraphs via Subgradient Rescaling

Privacy Preservation in Distributed Subgradient Optimization Algorithms

Differentially Private Greedy Decision Forest

Privacy-Preserving Distributed Optimization and Learning

A Privacy-Preserving Finite-Time Push-Sum based Gradient Method for Distributed Optimization over Digraphs

Privacy-preserving data publishing: an information-driven distributed genetic algorithm

A General Framework for Distributed Partitioned Optimization

A general framework for privacy-preserving of data publication based on randomized response techniques

Privacy Preserving Collaborative Computing: Heterogeneous Privacy Guarantee and Efficient Incentive Mechanism

Decentralized Stochastic Optimization with Inherent Privacy Protection

Privacy-Preserving Machine Learning Algorithms for Big Data Systems

Cryptography-Based Privacy-Preserving Method for Distributed Optimization over Time-Varying Directed Graphs with Enhanced Efficiency

Protecting Privacy through Distributed Computation in Multi-agent Decision Making

Privacy-Preserving Generalized Linear Models using Distributed Block Coordinate Descent

A Novel Privacy Preserving Framework for Large Scale Graph Data Publishing

GAPBAS: Genetic Algorithm-based Privacy Budget Allocation Strategy in Differential Privacy K-Means Clustering Algorithm