Abstract:Federated learning is an emerging paradigm of distributed collaborative machine learning , which allows different data nodes to train together for building a better model. Recently, privacy-preserving federated logistic regression has been widely concerned by academia and industry, which exploits techniques such as secure multi-party computation (MPC), homomorphic encryption (HE), and differential privacy (DP) to train shared model among different data nodes. However, MPC-based schemes could not efficiently handle high-dimensional sparse data and have high communication burden; HE-based schemes have potential information leakage risks and high computational burden; DP-based schemes affect the speed of model convergence and cause a loss of model accuracy. Besides, some of the existing schemes require a trusted third-party (TTP) coordinator, which greatly increases the complexity of training. To address these problems, in this paper, combining the HE and secret sharing (SS), we present a peer-to-peer privacy-preserving vertical federated logistic regression (VFLR) without TTP, which can securely train a shared model over vertically partitioned large-scale data from two data nodes. Moreover, to ensure the security of the training process, the proposed scheme secretly shares model weights between two data nodes, rather than reveals them to both parties during model training. Furthermore, the proposed scheme utilizes the single instruction multiple data (SIMD) and batching to achieve parallel processing and time amortization. Finally, the experimental evaluations demonstrate that the proposed scheme has less training time and better model performance than existing schemes.

Privacy-preserving Heterogeneous Federated Transfer Learning.

A Survey on Heterogeneous Federated Learning

Completely Heterogeneous Federated Learning

A Secure Federated Transfer Learning Framework

Semi-Supervised Federated Heterogeneous Transfer Learning

Privacy preserving federated learning for full heterogeneity

HQsFL: A Novel Training Strategy for Constructing High-performance and Quantum-safe Federated Learning

Federated Transfer Learning with Differential Privacy

Differentially Private Federated Learning on Heterogeneous Data

Efficient Vertical Federated Learning with Secure Aggregation

Federated Learning on Heterogeneous and Long-Tailed Data via Classifier Re-Training with Federated Features

Privacy-Preserving Federated Learning Using Homomorphic Encryption

Efficient federated learning privacy preservation method with heterogeneous differential privacy

Local differentially private federated learning with homomorphic encryption

FedML-HE: An Efficient Homomorphic-Encryption-Based Privacy-Preserving Federated Learning System

Heterogeneous Federated Learning via Grouped Sequential-to-Parallel Training

On the Impact of Data Heterogeneity in Federated Learning Environments with Application to Healthcare Networks

Hierarchical federated learning with global differential privacy

A flexible and privacy-preserving federated learning framework based on logistic regression

Peer-to-peer privacy-preserving vertical federated learning without trusted third-party coordinator

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing