Abstract:Personalized federated learning with differential privacy has been considered a feasible solution to address non-IID distribution of data and privacy leakage risks. However, current personalized federated learning methods suffer from inflexible personalization and convergence difficulties due to two main factors: 1) Firstly, we observe that the prevailing personalization methods mainly achieve this by personalizing a fixed portion of the model, which lacks flexibility. 2) Moreover, we further demonstrate that the default gradient calculation is sensitive to the widely-used clipping operations in differential privacy, resulting in difficulties in convergence. Considering that Fisher information values can serve as an effective measure for estimating the information content of parameters by reflecting the model sensitivity to parameters, we aim to leverage this property to address the aforementioned challenges. In this paper, we propose a novel federated learning method with D ynamic Fisher P ersonalization and A daptive Constraint (FedDPA) to handle these challenges. Firstly, by using layer-wise Fisher information to measure the information content of local parameters, we retain local parameters with high Fisher values during the personalization process, which are considered informative, simultaneously prevent these parameters from noise perturbation. Secondly, we introduce an adaptive approach by applying differential constraint strategies to personalized parameters and shared parameters identified in the previous for better convergence. Our method boosts performance through flexible personalization while mitigating the slow convergence caused by clipping operations. Experimental results on CIFAR-10, FEMNIST and SVHN dataset demonstrate the effectiveness of our approach in achieving better performance and robustness against clipping, under personalized federated learning with differential privacy.

PADP-FedMeta: A Personalized and Adaptive Differentially Private Federated Meta Learning Mechanism for AIoT

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

Aldp-fl: an adaptive local differential privacy-based federated learning mechanism for IoT

Personalized Federated Learning With Differential Privacy and Convergence Guarantee

Federated Learning Model with Adaptive Differential Privacy Protection in Medical IoT

Dynamic Personalized Federated Learning with Adaptive Differential Privacy

Fed-PEMC: A Privacy-Enhanced Federated Deep Learning Algorithm for Consumer Electronics in Mobile Edge Computing

Differentially Private Federated Learning with an Adaptive Noise Mechanism

PT-ADP: A Personalized Privacy-Preserving Federated Learning Scheme Based on Transaction Mechanism

Asynchronous Federated Learning with Differential Privacy for Edge Intelligence

Differentially Private Federated Learning on Non-iid Data: Convergence Analysis and Adaptive Optimization

FLPP: A Federated-Learning-Based Scheme for Privacy Protection in Mobile Edge Computing

Applied Federated Learning: Architectural Design for Robust and Efficient Learning in Privacy Aware Settings

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing

Idp-Fl: A Fine-Grained and Privacy-Aware Federated Learning Framework for Deep Neural Networks

FedPE: Adaptive Model Pruning-Expanding for Federated Learning on Mobile Devices

Differentially Private Federated Learning: Algorithm, Analysis and Optimization

ALI-DPFL: Differentially Private Federated Learning with Adaptive Local Iterations

PADL: Privacy-Aware and Asynchronous Deep Learning for IoT Applications

Enhancing Federated Learning with Adaptive Differential Privacy and Priority-Based Aggregation

Multi-Stage Asynchronous Federated Learning with Adaptive Differential Privacy.