Abstract:Conventional synchronous federated learning (SFL) frameworks suffer from performance degradation in heterogeneous systems due to imbalanced local data size and diverse computing power on the client side. To address this problem, asynchronous FL (AFL) and semi-asynchronous FL have been proposed to recover the performance loss by allowing asynchronous aggregation. However, asynchronous aggregation incurs a new problem of inconsistency between local updates and global updates. Motivated by the issues of conventional SFL and AFL, we first propose a time-driven SFL (T-SFL) framework for heterogeneous systems. The core idea of T-SFL is that the server aggregates the models from different clients, each with varying numbers of iterations, at regular time intervals. To evaluate the learning performance of T-SFL, we provide an upper bound on the global loss function. Further, we optimize the aggregation weights to minimize the developed upper bound. Then, we develop a discriminative model selection (DMS) algorithm that removes local models from clients whose number of iterations falls below a predetermined threshold. In particular, this algorithm ensures that each client's aggregation weight accurately reflects its true contribution to the global model update, thereby improving the efficiency and robustness of the system. To validate the effectiveness of T-SFL with the DMS algorithm, we conduct extensive experiments using several popular datasets including MNIST, Cifar-10, Fashion-MNIST, and SVHN. The experimental results demonstrate that T-SFL with the DMS algorithm can reduce the latency of conventional SFL by 50\%, while achieving an average 3\% improvement in learning accuracy over state-of-the-art AFL algorithms.

Multimodal Fusion with Block Term Decomposition for Asynchronous Federated Learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

Asynchronous Federated Learning over Wireless Communication Networks.

A unified framework for multi-modal federated learning

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

AsyFed: Accelerated Federated Learning with Asynchronous Communication Mechanism

Mitigating System Bias in Resource Constrained Asynchronous Federated Learning Systems

Multimodal Federated Learning

FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation

Robust Model Aggregation for Heterogeneous Federated Learning: Analysis and Optimizations

Multimodal Federated Learning: A Survey

FedMFS: Federated Multimodal Fusion Learning with Selective Modality Communication

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients

Asynchronous Federated Learning on Heterogeneous Devices: A Survey

Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection

AEDFL: Efficient Asynchronous Decentralized Federated Learning with Heterogeneous Devices

Modality Alignment Meets Federated Broadcasting

Leveraging Foundation Models for Multi-modal Federated Learning with Incomplete Modality

BAFL: A Blockchain-Based Asynchronous Federated Learning Framework