Abstract:—A traditional federated learning (FL) system allows clients to collaboratively train a global model under the coordination of a central server, which sparks great interests in exploiting the private data distributed on clients’ local devices. However, once the central server suffers from a single point of failure, it will lead to system crash. In addition, the FL system usually involves a large number of clients, which requires expensive communication costs. These challenges inspire a communication-efﬁcient design of decentralized FL systems. In this paper, we propose an efﬁcient and privacy-preserving global model training protocol in the context of FL in large-scale peer-to-peer networks, CFL. The proposed CFL protocol aggregates local model update parameters hierarchically by a cluster-based aggregation mode, as well as a leverged authenticated encryption scheme to ensure the security communication, whose key is distributed by a modiﬁed secure communication key establishment protocol. Theoretical analyses show that the proposed CFL protocol guarantees the privacy of local model update parameters, as well as integrity and authenticity under the widespread internal semi-honest and external malicious threat models. In particular, the proposed key revocation based on public voting can effectively defense against external adversaries hijacking honest participants to ensure the conﬁdentiality of the communication keys. In addition, the modiﬁed secure communication key establishment protocol indeed achieves high network connectivity probability to ensure transmission security of the system. Moreover, experimental results on the Trec06p and Trec07 datasets show that the ﬁnal global model trained through the proposed CFL protocol can achieve an accuracy of 99.32% after 14 training rounds, which is comparable to the accuracy and convergence speed of the PPT protocol. The proposed CFL protocol is equally excellent even facing dropout clients. Compared with the PPT protocol, the CFL protocol improves communication efﬁciency by 43.25% and computational efﬁciency by 0.87%.

A Framework of Large-Scale Peer-to-Peer Learning System

BlockDFL: A Blockchain-based Fully Decentralized Peer-to-Peer Federated Learning Framework

Communication-Efficient Cluster Federated Learning in Large-scale Peer-to-Peer Networks.

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Robust Peer-to-peer Learning Via Secure Multi-Party Computation

Asynchronous Federated Learning over Wireless Communication Networks.

Towards Effective Clustered Federated Learning: A Peer-to-peer Framework with Adaptive Neighbor Matching

Decentralized P2P Federated Learning for Privacy-Preserving and Resilient Mobile Robotic Systems

CFL: Cluster Federated Learning in Large-scale Peer-to-Peer Networks

Asynchronous Online Federated Learning with Reduced Communication Requirements

DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training

FedPAE: Peer-Adaptive Ensemble Learning for Asynchronous and Model-Heterogeneous Federated Learning

Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients

PPT: A Privacy-Preserving Global Model Training Protocol for Federated Learning in P2P Networks

Pfedlhns: Personalized Federated Learning Via Local Hypernetworks

Federation-Paced Learning: Towards Efficient Federated Learning with Synchronized Pace

SCALE: Self-regulated Clustered federAted LEarning in a Homogeneous Environment

Federated Continuous Learning With Broad Network Architecture

Safely Learning with Private Data: A Federated Learning Framework for Large Language Model

WPFed: Web-based Personalized Federation for Decentralized Systems

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing