Abstract:—A traditional federated learning (FL) system allows clients to collaboratively train a global model under the coordination of a central server, which sparks great interests in exploiting the private data distributed on clients’ local devices. However, once the central server suffers from a single point of failure, it will lead to system crash. In addition, the FL system usually involves a large number of clients, which requires expensive communication costs. These challenges inspire a communication-efﬁcient design of decentralized FL systems. In this paper, we propose an efﬁcient and privacy-preserving global model training protocol in the context of FL in large-scale peer-to-peer networks, CFL. The proposed CFL protocol aggregates local model update parameters hierarchically by a cluster-based aggregation mode, as well as a leverged authenticated encryption scheme to ensure the security communication, whose key is distributed by a modiﬁed secure communication key establishment protocol. Theoretical analyses show that the proposed CFL protocol guarantees the privacy of local model update parameters, as well as integrity and authenticity under the widespread internal semi-honest and external malicious threat models. In particular, the proposed key revocation based on public voting can effectively defense against external adversaries hijacking honest participants to ensure the conﬁdentiality of the communication keys. In addition, the modiﬁed secure communication key establishment protocol indeed achieves high network connectivity probability to ensure transmission security of the system. Moreover, experimental results on the Trec06p and Trec07 datasets show that the ﬁnal global model trained through the proposed CFL protocol can achieve an accuracy of 99.32% after 14 training rounds, which is comparable to the accuracy and convergence speed of the PPT protocol. The proposed CFL protocol is equally excellent even facing dropout clients. Compared with the PPT protocol, the CFL protocol improves communication efﬁciency by 43.25% and computational efﬁciency by 0.87%.

Communication-Efficient and Model-Heterogeneous Personalized Federated Learning via Clustered Knowledge Transfer

Cooperative Multi-Model Training for Personalized Federated Learning over Heterogeneous Devices

Optimizing Efficient Personalized Federated Learning with Hypernetworks at Edge

Communication Optimization Techniques in Personalized Federated Learning: Applications, Challenges and Future Directions

HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients

Like Attracts Like: Personalized Federated Learning in Decentralized Edge Computing

Communication Efficient Federated Learning With Heterogeneous Structured Client Models

Computation and Communication Efficient Federated Learning With Adaptive Model Pruning

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Personalized Federated Learning with Model Interpolation among Client Clusters and Its Application in Smart Home

FedPE: Adaptive Model Pruning-Expanding for Federated Learning on Mobile Devices

FedPCC: Parallelism of Communication and Computation for Federated Learning in Wireless Networks

Over-the-Air Hierarchical Personalized Federated Learning

DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training

Communication-Efficient Cluster Federated Learning in Large-scale Peer-to-Peer Networks.

Communication-Efficient Personalized Federated Learning for Green Communications in IoMT

FedStar: Efficient Federated Learning on Heterogeneous Communication Networks

Straggler-resilient Federated Learning: Tackling Computation Heterogeneity with Layer-wise Partial Model Training in Mobile Edge Network

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

ClassTer: Mobile Shift-Robust Personalized Federated Learning Via Class-Wise Clustering

Enhancing Decentralized Federated Learning with Model Pruning and Adaptive Communication