Abstract:With the emergence of privacy leaks in federated learning, secure aggregation protocols that mainly adopt either homomorphic encryption or threshold secret sharing have been widely developed for federated learning to protect the privacy of the local training data of each client. However, these existing protocols suffer from many shortcomings, such as the dependence on a trusted third party, the vulnerability to clients being corrupted, low efficiency, the trade-off between security and fault tolerance, etc. To solve these disadvantages, we propose an efficient and multi-private key secure aggregation scheme for federated learning. Specifically, we skillfully modify the variant ElGamal encryption technique to achieve homomorphic addition operation, which has two important advantages: 1) The server and each client can freely select public and private keys without introducing a trust third party and 2) Compared to the variant ElGamal encryption, the plaintext space is relatively large, which is more suitable for the deep model. Besides, for the high dimensional deep model parameter, we introduce a super-increasing sequence to compress multi-dimensional data into 1-D, which can greatly reduce encryption and decryption times as well as communication for ciphertext transmission. Detailed security analyses show that our proposed scheme achieves the semantic security of both individual local gradients and the aggregated result while achieving optimal robustness in tolerating both client collusion and dropped clients. Extensive simulations demonstrate that the accuracy of our scheme is almost the same as the non-private approach, while the efficiency of our scheme is much better than the state-of-the-art homomorphic encryption-based secure aggregation schemes. More importantly, the efficiency advantages of our scheme will become increasingly prominent as the number of model parameters increases.

An Efficient Learning Framework for Federated XGBoost Using Secret Sharing and Distributed Optimization

FedXGBoost: Privacy-Preserving XGBoost for Federated Learning

A Hybrid-Domain Framework for Secure Gradient Tree Boosting.

Towards End-to-End Secure and Efficient Federated Learning for XGBoost

ELXGB: an Efficient and Privacy-Preserving XGBoost for Vertical Federated Learning

Boosting Privately: Federated Extreme Gradient Boosting for Mobile Crowdsensing

SGBoost: An Efficient and Privacy-Preserving Vertical Federated Tree Boosting Framework

Secure Collaborative Training and Inference for XGBoost

The Tradeoff Between Privacy and Accuracy in Anomaly Detection Using Federated XGBoost

Large-scale Secure XGB for Vertical Federated Learning

FedGBF: An efficient vertical federated learning framework via gradient boosting and bagging

Blockchain-Based Efficiently Privacy-Preserving Federated Learning Framework Using Shamir Secret Sharing

HQsFL: A Novel Training Strategy for Constructing High-performance and Quantum-safe Federated Learning

Gradient-less Federated Gradient Boosting Trees with Learnable Learning Rates

A Fair and Efficient Hybrid Federated Learning Framework based on XGBoost for Distributed Power Prediction

Achieving Privacy-Preserving Cross-Silo Anomaly Detection Using Federated XGBoost

SecureBoost: A Lossless Federated Learning Framework

Efficient Batch Homomorphic Encryption for Vertically Federated XGBoost

Efficient secure aggregation for privacy-preserving federated learning based on secret sharing

An Efficient and Multi-private Key Secure Aggregation for Federated Learning

EPFed: Achieving Optimal Balance between Privacy and Efficiency in Federated Learning