Abstract:Robust machine learning (ML) models can be developed by leveraging large volumes of data and distributing the computational tasks across numerous devices or servers. Federated learning (FL) is a technique in the realm of ML that facilitates this goal by utilizing cloud infrastructure to enable collaborative model training among a network of decentralized devices. Beyond distributing the computational load, FL targets the resolution of privacy issues and the reduction of communication costs simultaneously. To protect user privacy, FL requires users to send model updates rather than transmitting large quantities of raw and potentially confidential data. Specifically, individuals train ML models locally using their own data and then upload the results in the form of weights and gradients to the cloud for aggregation into the global model. This strategy is also advantageous in environments with limited bandwidth or high communication costs, as it prevents the transmission of large data volumes. With the increasing volume of data and rising privacy concerns, alongside the emergence of large-scale ML models like Large Language Models (LLMs), FL presents itself as a timely and relevant solution. It is therefore essential to review current FL algorithms to guide future research that meets the rapidly evolving ML demands. This survey provides a comprehensive analysis and comparison of the most recent FL algorithms, evaluating them on various fronts including mathematical frameworks, privacy protection, resource allocation, and applications. Beyond summarizing existing FL methods, this survey identifies potential gaps, open areas, and future challenges based on the performance reports and algorithms used in recent studies. This survey enables researchers to readily identify existing limitations in the FL field for further exploration.

The Landscape of Modern Machine Learning: A Review of Machine, Distributed and Federated Learning

Distributed Compression in the Era of Machine Learning: A Review of Recent Advances

"Federated Learning: Advancements, Applications, and Future Directions for Collaborative Machine Learning in Distributed Environments"

Exploring Machine Learning Models for Federated Learning: A Review of Approaches, Performance, and Limitations

A Systematic Literature Review on Federated Machine Learning: From A Software Engineering Perspective

A Generalized Look at Federated Learning: Survey and Perspectives

Addressing modern and practical challenges in machine learning: a survey of online federated and transfer learning

A Survey From Distributed Machine Learning to Distributed Deep Learning

Review of Machine learning: Views, Architectures or Techniques, Challenges and Future guidance and Real-world applications

Federated Learning: The Pioneering Distributed Machine Learning and Privacy-Preserving Data Technology

Federated Learning -- Methods, Applications and beyond

A Survey on Deep Learning: Algorithms, Techniques, and Applications.

Reviewing Federated Learning Aggregation Algorithms; Strategies, Contributions, Limitations and Future Perspectives

Federated Learning: Challenges, Methods, and Future Directions

Federated Learning Architecture: Design, Implementation, and Challenges in Distributed AI Systems

Federated learning: A cutting-edge survey of the latest advancements and applications

Federated learning: Overview, strategies, applications, tools and future directions

Systematic Review of Privacy-Preserving Distributed Machine Learning From Federated Databases in Health Care

From distributed machine learning to federated learning: In the view of data privacy and security

Federated Machine Learning: Concept and Applications

A Review of Data Mining, Big Data Analytics and Machine Learning Approaches