Abstract:In recent years, federated learning has made significant progress in preserving data privacy. In this paradigm, clients train local models without sharing their raw data, thereby substantially mitigating the vulnerability to private data exposure. However, it is still possible to infer clients’ raw data by leveraging the gradient parameters exchanged between the clients and the server. To address this problem, this paper proposes a novel algorithm that introduces deep compressed sensing into federated learning to support one time encryption, called FL-OTCSEnc, to secure the communication data exchanged between the clients and the server. The process starts by creating a dataset of deep learning model parameters and training a system for both encryption and decryption using deep compressed sensing. This system is then used to secure the communication between clients and the server in federated learning, by encrypting and decrypting the data exchanged. To enhance the security of the proposed algorithm, we introduce an assessment method for evaluating the security level of the clients, facilitating the selection of suitable candidates for deployment within distributed training encryption and decryption models that are updated in real time. To enhance the accuracy of the decrypted deep network model, we introduce a tandem loss function in the training process. Moreover, this paper proves that the proposed end-to-end encryption method satisfies additive homomorphic encryption properties. Extensive experiments demonstrate that the deep compressed sensing encryption in federated learning achieves promising results without increasing the computational complexity.

Enhanced Security with Encrypted Vision Transformer in Federated Learning

Enhancing Security Using Random Binary Weights in Privacy-Preserving Federated Learning

Disposable-key-based image encryption for collaborative learning of Vision Transformer

Privacy-Preserving Vision Transformer on Permutation-Encrypted Images

Enhanced Security against Adversarial Examples Using a Random Ensemble of Encrypted Vision Transformer Models

Privacy-Preserving Vision Transformer Using Images Encrypted with Restricted Random Permutation Matrices

Towards Multi-modal Transformers in Federated Learning

Efficient Fine-Tuning with Domain Adaptation for Privacy-Preserving Vision Transformer

Hidden Data Privacy Breaches in Federated Learning

A Secure Federated Transfer Learning Framework

Human-imperceptible, Machine-recognizable Images

EFTViT: Efficient Federated Training of Vision Transformers with Masked Images on Resource-Constrained Edge Devices

FL-OTCSEnc: Towards Secure Federated Learning with Deep Compressed Sensing

Visual Object Detection for Privacy-Preserving Federated Learning

Privacy-Preserving Image Classification Using Vision Transformer

Secure Federated Matrix Factorization

Federated Learning Privacy: Attacks, Defenses, Applications, and Policy Landscape - A Survey

A Random Ensemble of Encrypted Vision Transformers for Adversarially Robust Defense

An Empirical Analysis of Vision Transformer and CNN in Resource-Constrained Federated Learning

A TEE-Based Federated Privacy Protection Method: Proposal and Implementation

A Multi-Modal Vertical Federated Learning Framework Based on Homomorphic Encryption