Abstract:Most existing wireless federated learning (FL) studies focused on homogeneous model settings where devices train identical local models. In this setting, the devices with poor communication and computation capabilities may delay the global model update and degrade the performance of FL. Moreover, in the homogenous model settings, the scale of the global model is restricted by the device with the lowest capability. To tackle these challenges, this work proposes an adaptive model pruning-based FL (AMP-FL) framework, where the edge server dynamically generates sub-models by pruning the global model for devices’ local training to adapt their heterogeneous computation capabilities and time-varying channel conditions. Since the involvement of diverse structures of devices’ sub-models in the global model updating may negatively affect the training convergence, we propose compensating for the gradients of pruned model regions by devices’ historical gradients. We then introduce an age of information (AoI) metric to characterize the staleness of local gradients and theoretically analyze the convergence behaviour of AMP-FL. The convergence bound suggests scheduling devices with large AoI of gradients and pruning the model regions with small AoI for devices to improve the learning performance. Inspired by this, we define a new objective function, i.e., the average AoI of local gradients, to transform the inexplicit global loss minimization problem into a tractable one for device scheduling, model pruning, and resource block (RB) allocation design. Through detailed analysis, we derive the optimal model pruning strategy and transform the RB allocation problem into equivalent linear programming that can be effectively solved. Experimental results demonstrate the effectiveness and superiority of the proposed approaches. The proposed AMP-FL is capable of achieving 1.9x and 1.6x speed up for FL on MNIST and CIFAR-10 datasets in comparison with the FL schemes with homogeneous model settings.

A weighted adaptive-velocity self-organizing model and its high-speed performance.

Improving the consensus performance via predictive mechanisms

Accelerating Consensus of Self-Driven Swarm Via A Weighted Model

Weighted divergence correction scheme and its fast implementation

Accelerating Consensus of Self-Driven Swarm Via Adaptive Speed

AsyncFedED: Asynchronous Federated Learning with Euclidean Distance Based Adaptive Weight Aggregation

Adaptive User Selection and Bandwidth Allocation for Fast Convergence of Federated Learning in Wireless Networks

A Local Consistency Algorithm to Shorten the Convergence Time and Improve the Robustness of Self-propelled Swarms

Convergence Analysis and Performance of an Extended Central Force Optimization Algorithm

Adaptive Guaranteed-Performance Consensus Control for Multiagent Systems With an Adjustable Convergence Speed

Fast Online SVR Algorithm Based Adaptive Internal Model Control

Mesh optimization using an improved self-organizing mechanism

Self-supervised Adaptive Weighting for Cooperative Perception in V2V Communications

High-Fidelity Decision-Making and Simulation for Cooperative Autonomous Air Combat Considering the Effect of Flight Controller

Real-Time Fluid Simulation with Adaptive Sph

Adaptive Model Pruning for Communication and Computation Efficient Wireless Federated Learning

A Framework for Dynamical Distributed Flocking Control in Dense Environments

Data Fusion Algorithm for Heterogeneous Wireless Sensor Networks Based on Extreme Learning Machine Optimized by Particle Swarm Optimization

A Nonlinear African Vulture Optimization Algorithm Combining Henon Chaotic Mapping Theory and Reverse Learning Competition Strategy

A dynamic adaptive firefly algorithm with globally orientation

An improved swarm model with informed agents to prevent swarm-splitting