Abstract:Along with the popularity of Artificial Intelligence (AI) and Internet-of-Things (IoT), Federated Learning (FL) has attracted steadily increasing attentions as a promising distributed machine learning paradigm, which enables the training of a central model on for numerous decentralized devices without exposing their privacy. However, due to the biased data distributions on involved devices, FL inherently suffers from low classification accuracy in non-IID scenarios. Although various device grouping method have been proposed to address this problem, most of them neglect both i) distinct data distribution characteristics of heterogeneous devices, and ii) contributions and hazards of local models, which are extremely important in determining the quality of global model aggregation. In this paper, we present an effective FL method named FedEntropy with a novel dynamic device grouping scheme, which makes full use of the above two factors based on our proposed maximum entropy judgement <a class="link-external link-http" href="http://heuristic.Unlike" rel="external noopener nofollow">this http URL</a> existing FL methods that directly aggregate local models returned from all the selected devices, in one FL round FedEntropy firstly makes a judgement based on the pre-collected soft labels of selected devices and then only aggregates the local models that can maximize the overall entropy of these soft labels. Without collecting local models that are harmful for aggregation, FedEntropy can effectively improve global model accuracy while reducing the overall communication overhead. Comprehensive experimental results on well-known benchmarks show that, FedEntropy not only outperforms state-of-the-art FL methods in terms of model accuracy and communication overhead, but also can be integrated into them to enhance their classification performance.

FedREM: Guided Federated Learning in the Presence of Dynamic Device Unpredictability

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training

FedDdrl: Federated Double Deep Reinforcement Learning for Heterogeneous IoT with Adaptive Early Client Termination and Local Epoch Adjustment

Federated Learning with Dynamic Client Arrival and Departure: Convergence and Rapid Adaptation via Initial Model Construction

FedCAP: Robust Federated Learning via Customized Aggregation and Personalization

FedGroup: Efficient Clustered Federated Learning via Decomposed Data-Driven Measure

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection

AsyFed: Accelerated Federated Learning with Asynchronous Communication Mechanism

Fast Federated Learning in the Presence of Arbitrary Device Unavailability

FedEntropy: Efficient Device Grouping for Federated Learning Using Maximum Entropy Judgment

Federated Learning with Additional Mechanisms on Clients to Reduce Communication Costs

Efficient Federated Learning Using Dynamic Update and Adaptive Pruning with Momentum on Shared Server Data

FedHe: Heterogeneous Models and Communication-Efficient Federated Learning

An Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning

Dap-FL: Federated Learning Flourishes by Adaptive Tuning and Secure Aggregation

Preconditioned Federated Learning

Joint Local Relational Augmentation and Global Nash Equilibrium for Federated Learning with Non-IID Data

Recurrent Early Exits for Federated Learning with Heterogeneous Clients