Abstract:Federated Learning (FL) has emerged as a powerful paradigm for decentralized machine learning, enabling collaborative model training across diverse clients without sharing raw data. However, traditional FL approaches often face limitations in scalability and efficiency due to their reliance on synchronous client updates, which can result in significant delays and increased communication overhead, particularly in heterogeneous and dynamic environments. To address these challenges in this paper, we propose an Asynchronous Federated Learning (AFL) algorithm, which allows clients to update the global model independently and asynchronously. Our key contributions include a comprehensive convergence analysis of AFL in the presence of client delays and model staleness. By leveraging martingale difference sequence theory and variance bounds, we ensure robust convergence despite asynchronous updates. Assuming strongly convex local objective functions, we establish bounds on gradient variance under random client sampling and derive a recursion formula quantifying the impact of client delays on convergence. Furthermore, we demonstrate the practical applicability of AFL by training a decentralized Long Short-Term Memory (LSTM)-based deep learning model on the CMIP6 climate dataset, effectively handling non-IID and geographically distributed data. The proposed AFL algorithm addresses key limitations of traditional FL methods, such as inefficiency due to global synchronization and susceptibility to client drift. It enhances scalability, robustness, and efficiency in real-world settings with heterogeneous client populations and dynamic network conditions. Our results underscore the potential of AFL to drive advancements in distributed learning systems, particularly for large-scale, privacy-preserving applications in resource-constrained environments.

Voting Consensus Based Decentralized Federated Learning

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Decentralized Federated Learning with Markov Chain Based Consensus for Industrial IoT Networks

Decentralized Federated Learning under Communication Delays.

Confederated Learning: Federated Learning with Decentralized Edge Servers

A Communication-efficient Federated Learning Assisted by Central Data: Implementation of Vertical Training into Horizontal Federated Learning

Decentralized Federated Learning Via Mutual Knowledge Distillation.

A Decentralized Federated Learning Framework Via Committee Mechanism with Convergence Guarantee

Privacy-Preserving and Reliable Decentralized Federated Learning

When federated learning meets blockchain: A new distributed learning paradigm

PVD-FL: A Privacy-Preserving and Verifiable Decentralized Federated Learning Framework

Asynchronous Federated Learning: A Scalable Approach for Decentralized Machine Learning

A Survey on Decentralized Federated Learning

DACFL: Dynamic Average Consensus-Based Federated Learning in Decentralized Sensors Network.

Decentralized Federated Learning for Industrial IoT with Deep Echo State Networks

Federated Learning with Cooperating Devices: A Consensus Approach for Massive IoT Networks

"Federated Learning: Advancements, Applications, and Future Directions for Collaborative Machine Learning in Distributed Environments"

Enhancing Decentralized Federated Learning with Model Pruning and Adaptive Communication

A Communication Efficient Vertical Federated Learning Framework.

A Blockchain-based Decentralized Federated Learning Framework with Committee Consensus

A Trusted Consensus Fusion Scheme for Decentralized Collaborated Learning in Massive IoT Domain