Abstract:Personalized federated learning (PFL) has gained increasing attention due to its success in handling the statistical heterogeneity of participants' local data by building distinct local models for participants. However, existing PFL schemes require the identical architecture and size of participants' models, e.g., the same number of layers in convolutional neural networks (CNN). In addition, the growing privacy issues (e.g., local update leakage to the curious server in model aggregation) have not been resolved in PFL. The utilization of identical model architectures among participants reduces the cost of privacy attacks since only one uniform attack method is required to extract private information, exacerbating the privacy threat. This paper proposes a novel privacy-preserving PFL framework that supports heterogeneous model architectures and sizes in delivering personalized models for different participants. Specifically, we utilize participants' knowledge, i.e., the soft predictions of local models on a public dataset, to effectively identify participants with similar data distributions regardless of the specific model architectures used. Based on the participants' knowledge, and their computing and storage capabilities, we employ the affinity propagation (AP) algorithm to implement a multi-level participant clustering mechanism for enabling heterogeneous PFL. Since knowledge is independent of original data, it is considered privacy-preserving during the clustering process. We also devise the ring aggregation algorithm to guarantee participants' privacy during the federated training process. In this way, each participant benefits from other participants with similar data distributions privately and obtains a satisfying personalized model. Furthermore, the cross-cluster knowledge transfer method boosts the personalization performance of weak participants. Sufficient theoretical analyses prove the effectiveness and privacy-preserving capacity of the proposed scheme. Extensive experiments on three benchmark datasets also demonstrate the superiority of our proposed scheme in various settings while maintaining privacy protection, outperforming other state-of-the-art schemes.

Privacy protection in intelligent vehicle networking: A novel federated learning algorithm based on information fusion

Privacy-Preserved Federated Learning for Autonomous Driving

Federated Split Learning with Data and Label Privacy Preservation in Vehicular Networks

Verifiable and Privacy-Preserving Cooperative Federated Learning in UAV-Assisted Vehicular Networks

Personalized Privacy-Preserving Distributed Artificial Intelligence for Digital-Twin-Driven Vehicle Road Cooperation

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

Joint Top-K Sparsification and Shuffle Model for Communication-Privacy-Accuracy Tradeoffs in Federated Learning-Based IoV

A Conditional Privacy-Preserving Identity-Authentication Scheme for Federated Learning in the Internet of Vehicles

PPFed: A Privacy-Preserving and Personalized Federated Learning Framework

A Privacy-Preserving Data Aggregation Protocol for Internet of Vehicles with Federated Learning

Deep Federated Learning for Autonomous Driving

FedComm: A Privacy-Enhanced and Efficient Authentication Protocol for Federated Learning in Vehicular Ad-Hoc Networks

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing

Personalized Privacy-Preserving Federated Learning: Optimized Trade-off Between Utility and Privacy

Privacy-Preserving Heterogeneous Personalized Federated Learning with Knowledge

Federated learning‐based trajectory prediction model with privacy preserving for intelligent vehicle

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Federated Learning with Privacy-preserving and Model IP-right-protection

Federated Vehicular Transformers and Their Federations: Privacy-Preserving Computing and Cooperation for Autonomous Driving

Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence