Abstract:We address the problem of client participation in federated learning, where traditional methods typically rely on a random selection of a small subset of clients for each training round. In contrast, we propose FedBack, a deterministic approach that leverages control-theoretic principles to manage client participation in ADMM-based federated learning. FedBack models client participation as a discrete-time dynamical system and employs an integral feedback controller to adjust each client's participation rate individually, based on the client's optimization dynamics. We provide global convergence guarantees for our approach by building on the recent federated learning research. Numerical experiments on federated image classification demonstrate that FedBack achieves up to 50\% improvement in communication and computational efficiency over algorithms that rely on a random selection of clients.

What problem does this paper attempt to address?

### Problems the paper attempts to solve This paper aims to solve the client participation problem in Federated Learning (FL), especially how to effectively control and optimize client participation to reduce communication and computing overhead. Traditional methods usually rely on randomly selecting a small number of clients for each round of training. This method will lead to high communication costs and latency in large - scale networks and cannot fully utilize the resources of each client. Specifically, the paper proposes a new method named **FedBack**, which dynamically adjusts the participation rate of each client by introducing a feedback control mechanism. The main problems include: 1. **Low communication efficiency**: Frequent model parameter exchanges lead to high communication costs. 2. **Waste of computing resources**: Randomly selected clients may not be able to fully utilize their computing resources. 3. **Non - i.i.d. data (Non - independently and identically distributed data)**: The data distribution of different clients varies greatly, which affects the convergence and performance of the global model. ### FedBack solution FedBack solves the above problems in the following ways: - **Based on the ADMM framework**: Use the Alternating Direction Method of Multipliers (ADMM) as an optimization framework and combine it with an event - triggered communication strategy. - **Feedback control mechanism**: Model client participation as a discrete - time dynamic system and use an integral feedback controller to dynamically adjust the participation rate according to the client's optimization. - **Adaptive threshold adjustment**: Dynamically adjust the communication threshold \(\delta\) to adapt to changes in network conditions, model accuracy requirements, and device capabilities. Through these improvements, FedBack significantly improves communication and computing efficiency while maintaining global convergence. ### Experimental results Experiments show that compared with existing FL algorithms such as FedAvg, FedProx, and FedADMM, FedBack performs better on the MNIST and CIFAR - 10 datasets. Especially in the case of low participation rates, it can reach the target accuracy faster and reduce the variance of server parameters. ### Summary By introducing a feedback control mechanism, the paper successfully solves the client participation problem in Federated Learning, achieving better communication and computing efficiency while maintaining the stability and convergence of the model. This method is especially suitable for situations where communication resources are limited or changeable in practical application scenarios.

Controlling Participation in Federated Learning with Feedback

Adaptive Client Sampling in Federated Learning via Online Learning with Bandit Feedback

Federated Learning with Regularized Client Participation

Anchor Sampling for Federated Learning with Partial Client Participation

A Unified Analysis of Federated Learning with Arbitrary Client Participation

Emulating Full Client Participation: A Long-Term Client Selection Strategy for Federated Learning

FedCM: Federated Learning with Client-level Momentum

FedADMM: A Robust Federated Deep Learning Framework with Adaptivity to System Heterogeneity

Beyond ADMM: A Unified Client-variance-reduced Adaptive Federated Learning Framework

Communication-Efficient Federated Learning with Acceleration of Global Momentum

Noise-Robust and Resource-Efficient ADMM-based Federated Learning

FedECADO: A Dynamical System Model of Federated Learning

FedUB: Federated Learning Algorithm Based on Update Bias

FedCAda: Adaptive Client-Side Optimization for Accelerated and Stable Federated Learning

Accelerating Hybrid Federated Learning Convergence under Partial Participation

Federated Learning under Periodic Client Participation and Heterogeneous Data: A New Communication-Efficient Algorithm and Analysis

DFedADMM: Dual Constraints Controlled Model Inconsistency for Decentralized Federated Learning

Efficient Federated Learning via Local Adaptive Amended Optimizer with Linear Speedup

FedADMM-InSa: An Inexact and Self-Adaptive ADMM for Federated Learning

FedBalancer: Data and Pace Control for Efficient Federated Learning on Heterogeneous Clients