Abstract:Federated learning (FL) enables collaborative model training across massively distributed edge devices, such as Internet of Things (IoT) nodes. However, resource constraints impose a major challenge, as there exists a trade-off between maximizing learning accuracy and minimizing communication overhead between the resource-limited devices. In this paper, we present a device selection approach for heterogeneous FL systems based on multi-objective optimization and knowledge transfer. We formulate the resource constraint in federated optimization as a multi-objective problem, and obtain Pareto-optimal solutions balancing resource efficiency and test accuracy. Additionally, we introduce an innovative knowledge transfer mechanism that propagates the globally optimal models obtained during multi-objective optimization to subsequent FL tasks, further expediting convergence. The multi-objective formulation and knowledge transfer provide new insights into efficient and robust federated learning for resource-constrained IoT applications. We conduct extensive experiments on real-world datasets. Results demonstrate that our method achieves up to 11% higher accuracy than state-of-the-art methods, while effectively mitigating resource constraints. Impact Statement–Federated learning is an efficient algorithm that enables everything to be interconnected without sharing data. However, resource constraint is the main challenge for federated optimization problems. Although many works have proposed various solutions from different perspectives, these methods cannot simultaneously minimize the communication resource cost while ensuring algorithm performance. We propose an automatic device selection algorithm for federated systems based on multi-objective optimization and knowledge transfer. This work not only reduces the global resource usage rate of federated learning, but also enables it to converge quickly.

Federated Feature Selection for Horizontal Federated Learning in IoT Networks

Hierarchical Federated Learning for Heterogeneous Features and Distributed Data in IoT Networks.

H-FedSN: Personalized Sparse Networks for Efficient and Accurate Hierarchical Federated Learning for IoT Applications

Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced data

Privacy-preserving Data Selection for Horizontal and Vertical Federated Learning

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things

A Communication-efficient Federated Learning Assisted by Central Data: Implementation of Vertical Training into Horizontal Federated Learning

T-FedHA: A Trusted Hierarchical Asynchronous Federated Learning Framework for Internet of Things

FedHGL: Cross-Institutional Federated Heterogeneous Graph Learning for IoT

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Model-Heterogeneous Federated Learning for Internet of Things: Enabling Technologies and Future Directions

Information-Exchangeable Hierarchical Clustering for Federated Learning with Non-IID Data

Adaptive Personalized Federated Learning With One-Shot Screening

Data Selection for Efficient Model Update in Federated Learning

Towards a Federated Learning Framework for Heterogeneous Devices of Internet of Things

FMLFS: A Federated Multi-Label Feature Selection Based on Information Theory in IoT Environment

Optimizing Efficient Personalized Federated Learning with Hypernetworks at Edge

FedUSC: Collaborative Unsupervised Representation Learning from Decentralized Data for Internet of Things

Hybrid IoT Device Selection with Knowledge Transfer for Federated Learning

FedMint: Intelligent Bilateral Client Selection in Federated Learning with Newcomer IoT Devices