Abstract:With the arrival of the era of the Internet of Things (IoT), the rapid development of new technologies such as artificial intelligence, big data, and other advanced techniques, data is growing geometrically. These data are prone to form data silos, scattered in various places. Jointly decentralized data applications will accelerate the progress and development of the times, but also face the challenge of data privacy protection. Federated learning (FL), a new branch of distributed machine learning, is trained by collaborative training to obtain global model without direct exposure to local datasets. Some studies have shown that typically federated learning involves a larger number of participants, it can lead to a significant increase in communication overhead, resulting in issues such as higher latency and bandwidth consumption. We suggest masking a subset of diverse participants and allowing the remaining participants to proceed with the next communication round of updates. Our aim is for reducing the communication overhead and improving the convergence performance of the global model on the premise of heterogeneous data privacy protection. We design a private masking approach PrivMaskFL to address two problems. We firstly propose a dynamic participant aggregation masking approach, which adopts the greedy ideology to select the relatively important participants and mask the unimportant ones; secondly, we design an adaptive differential privacy approach, which adaptively stratifies privacy budget according to the characteristics of participant, allocates the budget in a fine-grained stratified level, and adds Gaussian noise reasonably. Specifically, in each communication round, the participant’s model needs to perform local differential privacy noise addition for uplink parameter transmission; the server aggregates to acquire global model, finds a candidate participant subset based on the smaller parameter divergence by using the greedy algorithm approximation for t + 1 -th communication round for downlink parameter transmission. Subsequently, the privacy budget sequence is divided and granted to the participants of the stratified level, and the Gaussian noise addition of adaptive differential privacy is completed to achieve privacy protection without compromising the model’s usability. In experiments, our approach reduces the communication overhead and improve the convergence performance. Furthermore, our approach achieves higher accuracy and robust variance on both FMNIST and FEMNIST datasets.

PA-iMFL: Communication-Efficient Privacy Amplification Method Against Data Reconstruction Attack in Improved Multi-Layer Federated Learning

PA-iMFL: Communication-Efficient Privacy Amplification Method against Data Reconstruction Attack in Improved Multi-Layer Federated Learning

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing

RPIFL: Reliable and Privacy-Preserving Federated Learning for the Internet of Things

Privacy-Preserving Federated Learning Against Label-Flipping Attacks on Non-IID Data

Private Federated Learning With Misaligned Power Allocation via Over-the-Air Computation

Efficient and Privacy-Enhanced Asynchronous Federated Learning for Multimedia Data in Edge-based IoT

PrivMaskFL: A private masking approach for heterogeneous federated learning in IoT

Differentially Private Over-the-Air Federated Learning Over MIMO Fading Channels

Secure Decentralized Aggregation to Prevent Membership Privacy Leakage in Edge-based Federated Learning

Enhancing IoT Security: A Novel Approach with Federated Learning and Differential Privacy Integration

Defending Against Data Reconstruction Attacks in Federated Learning: An Information Theory Approach

Shield Against Gradient Leakage Attacks: Adaptive Privacy-Preserving Federated Learning

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Private FLI: Anti-Gradient Leakage Recovery Data Privacy Architecture

Aldp-fl: an adaptive local differential privacy-based federated learning mechanism for IoT

A Novel Privacy Enhancement Scheme with Dynamic Quantization for Federated Learning

Edge-assisted U-Shaped Split Federated Learning with Privacy-preserving for Internet of Things

Practical Private Aggregation in Federated Learning Against Inference Attack

Performance Analysis and Optimization in Privacy-Preserving Federated Learning