Abstract:Federated learning (FL) is considered a de facto standard for privacy preservation in AI environments because it does not require data to be aggregated in some central place to train an AI model. Preserving data on the client side and sharing only the model's parameters with a central server preserves privacy while training an AI model of higher generalizability. Unfortunately, sharing the model's parameters with the server can create privacy leaks, and therefore, FL is unable to meet privacy requirements in many situations. Furthermore, FL is prone to other technical issues, such as data poisoning, model poisoning, fairness, client dropout, and convergence issues, to name just a few. In this work, we provide a multifaceted survey on FL, including its fundamentals, paradigm shifts, technical issues, recent developments, and future prospects. First, we discuss the fundamental concepts of FL (workflow, categorization, the differences between centralized learning and FL, and applications of FL in diverse fields), and we then discuss the paradigm shifts brought on by FL from a broader perspective (e.g., data use, AI model development, resource sharing, etc.). Later, we pinpoint ten practical issues currently hindering the viability of the FL landscape, and we discuss developments made under each issue by summarizing state-of-the-art (SOTA) literature. We highlight FL partnerships with two or more technologies that either improve practical aspects/issues in FL or extend its adoption to new areas/domains. We pinpoint various trade-offs that exist in an FL ecosystem, and the corresponding SOTA developments to mitigate them. We also discuss the latest studies that have been proposed to make FL trustworthy and beneficial for the community. Lastly, we suggest valuable research directions towards enhancing technical efficacy by guiding researchers to less explored topics in FL.

Synergizing Foundation Models and Federated Learning: A Survey

Advances and Open Challenges in Federated Foundation Models

When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions

A Survey on Efficient Federated Learning Methods for Foundation Model Training

Federated Foundation Models: Privacy-Preserving and Collaborative Learning for Large Models

Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare

Position Paper: Assessing Robustness, Privacy, and Fairness in Federated Learning Integrated with Foundation Models

Enabling Foundation Models: A Distributed Collaboration Framework Based on Graph Federated Learning

A Generalized Look at Federated Learning: Survey and Perspectives

Bridging the Gap Between Foundation Models and Heterogeneous Federated Learning

Federated learning: A cutting-edge survey of the latest advancements and applications

A Multifaceted Survey on Federated Learning: Fundamentals, Paradigm Shifts, Practical Issues, Recent Developments, Partnerships, Trade-Offs, Trustworthiness, and Ways Forward

The Role of Federated Learning in a Wireless World with Foundation Models

Multimodal Federated Learning: A Survey

Federated Large Language Models: Current Progress and Future Directions

FedFMSL: Federated Learning of Foundations Models with Sparsely Activated LoRA

FedMS: Federated Learning with Mixture of Sparsely Activated Foundations Models

A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiency

Advancements in Federated Learning: Models, Methods, and Privacy

Federated Generative Learning with Foundation Models

Navigating the Future of Federated Recommendation Systems with Foundation Models