Abstract:Federated learning (FL) enables collaborative model training across massively distributed edge devices, such as Internet of Things (IoT) nodes. However, resource constraints impose a major challenge, as there exists a trade-off between maximizing learning accuracy and minimizing communication overhead between the resource-limited devices. In this paper, we present a device selection approach for heterogeneous FL systems based on multi-objective optimization and knowledge transfer. We formulate the resource constraint in federated optimization as a multi-objective problem, and obtain Pareto-optimal solutions balancing resource efficiency and test accuracy. Additionally, we introduce an innovative knowledge transfer mechanism that propagates the globally optimal models obtained during multi-objective optimization to subsequent FL tasks, further expediting convergence. The multi-objective formulation and knowledge transfer provide new insights into efficient and robust federated learning for resource-constrained IoT applications. We conduct extensive experiments on real-world datasets. Results demonstrate that our method achieves up to 11% higher accuracy than state-of-the-art methods, while effectively mitigating resource constraints. Impact Statement–Federated learning is an efficient algorithm that enables everything to be interconnected without sharing data. However, resource constraint is the main challenge for federated optimization problems. Although many works have proposed various solutions from different perspectives, these methods cannot simultaneously minimize the communication resource cost while ensuring algorithm performance. We propose an automatic device selection algorithm for federated systems based on multi-objective optimization and knowledge transfer. This work not only reduces the global resource usage rate of federated learning, but also enables it to converge quickly.

Federated Split Learning for Distributed Intelligence with Resource-Constrained Devices

Federated Split Learning for Edge Intelligence in Resource-Constrained Wireless Networks

FedSL: Federated Split Learning for Collaborative Healthcare Analytics on Resource-Constrained Wearable IoMT Devices

Split Federated Learning Over Heterogeneous Edge Devices: Algorithm and Optimization

Decentralized Proactive Model Offloading and Resource Allocation for Split and Federated Learning

Accelerating Split Federated Learning over Wireless Communication Networks

Federated Learning in Multi-RIS-Aided Systems

Evaluation and Optimization of Distributed Machine Learning Techniques for Internet of Things

When Computing Power Network Meets Distributed Machine Learning: An Efficient Federated Split Learning Framework

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions

Split Federated Learning: Speed up Model Training in Resource-Limited Wireless Networks

Hybrid IoT Device Selection with Knowledge Transfer for Federated Learning

Low-Latency Federated Learning With DNN Partition in Distributed Industrial IoT Networks

Split Learning Over Wireless Networks: Parallel Design and Resource Management

FedSR: A Semi-Decentralized Federated Learning Algorithm for Non-IIDness in IoT System

A Survey on Federated Learning for Resource-Constrained IoT Devices

Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things

Communication-Efficient Device Scheduling via Over-the-Air Computation for Federated Learning

Federated Split Learning with Model Pruning and Gradient Quantization in Wireless Networks

Edge-assisted U-Shaped Split Federated Learning with Privacy-preserving for Internet of Things