Abstract:In this paper, a novel clustered FL framework that enables distributed edge devices with non-IID data to independently form several clusters in a distributed manner and implement FL training within each cluster is proposed. In particular, our designed clustered FL algorithm must overcome two challenges associated with FL training. First, the server has limited FL training information (i.e., the parameter server can only obtain the FL model information of each device) and limited computational power for finding the differences among a large amount of devices. Second, each device does not have the data information of other devices for device clustering and can only use global FL model parameters received from the server and its data information to determine its cluster identity, which will increase the difficulty of device clustering. To overcome these two challenges, we propose a joint gradient and loss based distributed clustering method in which each device determines its cluster identity considering the gradient similarity and training loss. The proposed clustering method not only considers how a local FL model of one device contributes to each cluster but also the direction of gradient descent thus improving clustering speed. By delegating clustering decisions to edge devices, each device can fully leverage its private data information to determine its own cluster identity, thereby reducing clustering overhead and improving overall clustering performance. Simulation results demonstrate that our proposed clustered FL algorithm can reduce clustering iterations by up to 99% compared to the existing baseline.

Clustered Federated Learning Multi-Classifier for Non-Iid Scenario in Drone Devices

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Hierarchical federated learning based on wireless D2D networks

Federated Cinn Clustering for Accurate Clustered Federated Learning

Clustered Federated Learning based on Nonconvex Pairwise Fusion

A Joint Gradient and Loss Based Clustered Federated Learning Design

Clustered Data Sharing for Non-IID Federated Learning over Wireless Networks

A Data Sharing Method for Internet of Drones Based on Federated Learning.

Data Collaborative Federated Learning for Non-i.i.d Data in Wireless Networks

Three-Stage Stackelberg Game Enabled Clustered Federated Learning in Heterogeneous UAV Swarms

Fuzzy Clustered Federated Learning under Mixed Data Distributions.

Federated Learning via Unmanned Aerial Vehicle

Distributed Learning for UAV Swarms

Optimizing Data-Driven Federated Learning in UAV Networks

On the Convergence of Clustered Federated Learning

Fed4UL: A Cloud–Edge–End Collaborative Federated Learning Framework for Addressing the Non-IID Data Issue in UAV Logistics

Blockchain-enabled Clustered and Scalable Federated Learning (BCS-FL) Framework in UAV Networks

Clustered Federated Learning with Model Integration for Non-IID Data in Wireless Networks.

A Clustered Federated Learning Method of User Behavior Analysis Based on Non-IID Data