Abstract:Federated learning (FL) enables collaborative model training across massively distributed edge devices, such as Internet of Things (IoT) nodes. However, resource constraints impose a major challenge, as there exists a trade-off between maximizing learning accuracy and minimizing communication overhead between the resource-limited devices. In this paper, we present a device selection approach for heterogeneous FL systems based on multi-objective optimization and knowledge transfer. We formulate the resource constraint in federated optimization as a multi-objective problem, and obtain Pareto-optimal solutions balancing resource efficiency and test accuracy. Additionally, we introduce an innovative knowledge transfer mechanism that propagates the globally optimal models obtained during multi-objective optimization to subsequent FL tasks, further expediting convergence. The multi-objective formulation and knowledge transfer provide new insights into efficient and robust federated learning for resource-constrained IoT applications. We conduct extensive experiments on real-world datasets. Results demonstrate that our method achieves up to 11% higher accuracy than state-of-the-art methods, while effectively mitigating resource constraints. Impact Statement–Federated learning is an efficient algorithm that enables everything to be interconnected without sharing data. However, resource constraint is the main challenge for federated optimization problems. Although many works have proposed various solutions from different perspectives, these methods cannot simultaneously minimize the communication resource cost while ensuring algorithm performance. We propose an automatic device selection algorithm for federated systems based on multi-objective optimization and knowledge transfer. This work not only reduces the global resource usage rate of federated learning, but also enables it to converge quickly.

Optimizing Tradeoff Between Learning Speed and Cost for Federated Learning-Enabled Industrial IoT

Resource Efficient Asynchronous Federated Learning for Digital Twin Empowered IoT Network

Deep Reinforcement Learning for Energy Efficiency Maximization in SWIPT-Based Over-the-Air Federated Learning

Low-Latency Federated Learning With DNN Partition in Distributed Industrial IoT Networks

Optimized Data Sampling and Energy Consumption in IIoT: A Federated Learning Approach

Efficient Adaptive Federated Optimization of Federated Learning for IoT

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Grouped federated learning for time-sensitive tasks in industrial IoTs

Hybrid IoT Device Selection with Knowledge Transfer for Federated Learning

Joint Resource Allocation for Efficient Federated Learning in Internet of Things Supported by Edge Computing.

Client Scheduling for Multi-Server Federated Learning in Industrial IoT With Unreliable Communications

Communication and Computation Efficient Federated Learning for Internet of Vehicles with a Constrained Latency

A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things

Toward Personalized Federated Learning Via Group Collaboration in IIoT

Optimizing Resource-Efficiency for Federated Edge Intelligence in IoT Networks

Learner Referral for Cost-Effective Federated Learning over Hierarchical IoT Networks.

Optimizing Federated Learning With Deep Reinforcement Learning for Digital Twin Empowered Industrial IoT

PCFed: Privacy-Enhanced and Communication-Efficient Federated Learning for Industrial IoTs

Efficiency-Boosting Federated Learning in Wireless Networks: A Long-Term Perspective

Evaluation and Optimization of Distributed Machine Learning Techniques for Internet of Things

Resource Allocation for Latency-Aware Federated Learning in Industrial Internet of Things