Abstract:Distributed (federated) machine learning requires agents, e.g., mobile devices and sensors, to exchange information with a parameter server, leading to substantial communication power consumption. Existing work on power management for distributed learning mainly focuses on single-task learning, where all agents seek to learn a common model. In this paper, we study power control for distributed multitask learning, where agents collaborate to train personalized models and infer their relationships. The agents communicate with a parameter server over noisy fading wireless channels, where information is transmitted imperfectly. We establish the convergence bound for the wireless distributed multitask learning system in terms of the transmission power of the agents. Building upon the convergence bound, we formulate a power control problem, whose goal is to optimize the learning performance under the power constraints of agents. This problem is challenging to solve since only causal information about channel states is available. To resolve this challenge, we resort to the Lyapunov optimization framework and propose an online power control algorithm, where a virtual power queue is constructed and updated at each agent. We analyze the performance of the proposed algorithm and establish dynamic regret bound and power overflow bound, where is the time horizon. Finally, numerical experiments on real-world datasets demonstrate that the proposed online power control algorithm outperforms existing benchmark schemes while satisfying the power constraints.

Learning in Wireless Control Systems over Non-Stationary Channels

Distributed Stochastic Optimization for Weakly Coupled Systems with Applications to Wireless Communications

On Iterative Learning Control for Remote Control Systems with Packet Losses.

Distributed Extremum Seeking and Formation Control for Nonholonomic Mobile Network.

Distributed Extremum Seeking And Cooperative Control For Mobile Communication

Approximate Optimal Control over Unreliable Communication Channels

Data-Driven Learning Control for Stochastic Nonlinear Systems: Multiple Communication Constraints and Limited Storage

Statistical Learning for Analysis of Networked Control Systems over Unknown Channels

Online Power Control for Distributed Multitask Learning Over Noisy Fading Wireless Channels

Infinite-Horizon Optimal Wireless Control Over Shared State-Dependent Fading Channels for IIoT Systems

Learning to Continuously Optimize Wireless Resource in a Dynamic Environment: A Bilevel Optimization Perspective

A Novel Self-Learning Optimal Control Approach for Decentralized Guaranteed Cost Control of A Class of Complex Nonlinear Systems

Learning to Schedule in Non-Stationary Wireless Networks With Unknown Statistics

Stability of Power Control in Multiple Coexisting Wireless Networks: an $\mathscr {L}_{2}$ Small-Gain Perspective

Co-design of Safe and Efficient Networked Control Systems in Factory Automation with State-dependent Wireless Fading Channels

Deep Learning for Wireless Networked Systems: a joint Estimation-Control-Scheduling Approach

Data-Driven Networked Optimal Iterative Learning Control for Discrete Linear Time-Varying Systems with One-Operation Bernoulli-Type Communication Delays

Decentralized Guaranteed Cost Control of Interconnected Systems with Uncertainties: A Learning-Based Optimal Control Strategy

Optimal output-feedback control and separation principle for Markov jump linear systems modeling wireless networked control scenarios (extended version)

Distributed Cooperative Learning Control of Uncertain Multiagent Systems With Prescribed Performance and Preserved Connectivity

Scheduling to Minimize Control Cost in Multi-loop Wireless Networked Control with Imperfect Sensors