Abstract:Federated Learning allows multiple participants to jointly train a global model while guaranteeing the confidentiality and integrity of private datasets. However, current server aggregation algorithms for federated learning only focus on model parameters, resulting in heavy communication costs and low convergence speed. Most importantly, they are unable to handle the scenario wherein different clients hold different local models with various network architectures. In this paper, we view these challenges from an alternative perspective: we draw attention to what should be aggregated and how to improve convergence efficiency. Specifically, we propose MHAT, a novel model-heterogenous aggregation training federated learning scheme which exploits a technique of Knowledge Distillation (KD) to extract the update information of the heterogenous model of all clients and trains an auxiliary model on the server to realize information aggregation. MHAT relaxes clients from fixing on an unified model architecture and significantly reduces the required computing resources while maintaining acceptable model convergence accuracy. Various experiments verify the effectiveness and applicability of our proposed scheme. (c) 2021 Elsevier Inc. All rights reserved. Federated learning 11?3] is an emerging machine learning paradigm for decentralized data 14,5], which enables multiple parties to collaboratively train a global model without sharing their private data. In the canonical federated learning protocol 16], model parameter is the interactive information between clients and the server. At the beginning of each training round, the central server distributes current global model to all participants, and all participants update the local model using their private data. Then the server will collect updated model information from all parties and obtain the central global model via a weighted average aggregation algorithm. However, in a practical federated learning, several major challenges still remain unsolved when using model parameters

An Efficient Multi-Model Training Algorithm for Federated Learning

Fairness and Accuracy in Federated Learning

Multi-Objective Federated Learning: Balancing Global Performance and Individual Fairness

Fairness and Accuracy in Horizontal Federated Learning

Fair Concurrent Training of Multiple Models in Federated Learning

MHAT: an Efficient Model-Heterogenous Aggregation Training Scheme for Federated Learning.

Federated Learning Optimization Algorithm for Automatic Weight Optimal

Multi-Model Federated Learning

Robust Model Aggregation for Federated Learning with Heterogeneous Clients

Optimizing Multimodal Federated Learning: Novel Approaches for Efficient Model Aggregation and Client Sampling

FedLaw: Value-Aware Federated Learning with Individual Fairness and Coalition Stability

Multi-Dimensional Fair Federated Learning

Fairness-Aware Client Selection for Federated Learning

Heterogeneity-aware Fair Federated Learning

Federated Learning Client Selection Mechanism under System and Data Heterogeneity

FedUP: Bridging Fairness and Efficiency in Cross-Silo Federated Learning

An Efficiency-Boosting Client Selection Scheme for Federated Learning With Fairness Guarantee

Federated Semi-Supervised Learning with Local and Global Updating Frequency Optimization

Communication-Efficient Federated Multi-Task Learning with Sparse Sharing

FedHCA$^2$: Towards Hetero-Client Federated Multi-Task Learning

Exploring System-Heterogeneous Federated Learning with Dynamic Model Selection