Abstract:Federated learning (FL) is a distributed machine learning paradigm in which multiple clients collaboratively learn a global model without sharing local training data. This study presents an adaptive model selection algorithm to enhance existing aggregation for FL. The proposed method uses sparsely learned local models and adaptively selects the best models based on the entropy-inspired information using the neural nodes of fully connected layers. This enables substantial nodes to be included in federated averaging (FedAvg), unlike standard FedAvg. In the case of a client model (at an embedded edge cluster), we exploited sparse learning to absorb more features associated with new classes by retraining weak neural nodes. For global model averaging, we used the proposed model selection technique to enhance the performance of traditional FedAvg by up to 20% in terms of global accuracy in the same number of rounds, which, in turn, has increased the convergence in federated rounds. For local sparse learning models, we simulated clients at edge clusters using the Docker container on embedded boards (NVIDIA Jetson Series). To ensure the efficacy of our proposed technique, we rigorously tested our algorithm on various datasets (CIFAR 10, MNIST, OCS lab(driving), UCI-HAR) using different models for image classification (EfficientNet, MobileNetv2, ResNet18) and time-series classification (FCN-LSTM, DepthConv-LSTM), and compared our algorithm with several state-of-the-art methods, such as FedAvg and FedFS. The proposed method outperformed the others in terms of generalizability and assists in converging earlier than existing algorithms in federated rounds.

Federated Learning Using Sparse-Adaptive Model Selection for Embedded Edge Computing

A Cluster-Driven Adaptive Training Approach for Federated Learning

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

EdgeFed: Optimized Federated Learning Based on Edge Computing

Straggler-Aware Federated Learning Based on Adaptive Clustering to Support Edge Intelligence

Data Selection for Efficient Model Update in Federated Learning

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

APCSMA: Adaptive Personalized Client-Selection and Model-Aggregation Algorithm for Federated Learning in Edge Computing Scenarios

FedEdge: Accelerating Edge-Assisted Federated Learning

Towards Efficient Federated Learning Framework Via Selective Aggregation of Models

Asynchronous Online Federated Learning for Edge Devices with Non-IID Data

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Federated Learning with Workload Reduction through Partial Training of Client Models and Entropy-Based Data Selection

FED-SDS: Adaptive Structured Dynamic Sparsity for Federated Learning under Heterogeneous Clients

Adaptive Federated Learning in Resource Constrained Edge Computing Systems

Accelerating Federated Learning with Data and Model Parallelism in Edge Computing

FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems

Client Selection for Federated Learning With Non-IID Data in Mobile Edge Computing

Towards addressing aggregation deviation for model training in resource-scarce edge environment

Adaptive Clustering Based Straggler-aware Federated Learning in Wireless Edge Networks

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking