Abstract:The expansion of the Internet of Things (IoT) has led to a significant surge in data flow over edge networks, posing substantial challenges to data mining and management. While federated edge learning (FEEL) effectively accomplishes global integration and local training based on decentralized datasets, its deployment across expansive IoT networks introduces additional challenges. The primary issues stem from managing the interaction between communication load and learning effectiveness. The communication loads driven by recurrent data exchanges between user equipment (UEs) and central servers exacerbate network congestion and latency issues. Moreover, the learning efficacy is undermined due to the typically non-independent and identically distributed (non-IID) characteristics of real-world IoT data. In this paper, a novel communication-efficient hierarchical FEEL framework is proposed to tackle these challenges. Specifically, UEs are adaptively clustered according to their link conditions, geographic locations, and data distributions. Small base stations (SBSs) collect local model updates from the UEs in their clusters and communicate with a macro base station (MBS) for global model aggregation. To jointly maximize the communication gain (in terms of reducing latency) and the learning gain (in terms of improving accuracy), a clustering and resource allocation optimization problem is formulated, and a cross entropy based method with low computational complexity is proposed. Numerical experiments validate that the proposed hierarchical FEEL system achieves fast convergence and significantly improves the system efficiency for various learning tasks and system settings.

Improve Prediction with Remote Learners in Internet Environment

Exploiting Remote Learners in Internet Environment with Agents

Collaborative Learning Between Cloud and End Devices

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

FAIR: Quality-Aware Federated Learning with Precise User Incentive and Model Aggregation.

Additive-Effect Assisted Learning

Decentralized Personalized Online Federated Learning

Federated Sensing : Edge-Cloud Elastic Collaborative Learning for Intelligent Sensing

Efficient Asynchronous Federated Learning Research in the Internet of Vehicles

Knowledge Transferring via Model Aggregation for Online Social Care

Asymmetric collaborative network: transferable lifelong learning for remote sensing images

Communication-Efficient Learning of Deep Networks from Decentralized Data

Communication-Efficient Wireless Traffic Prediction with Federated Learning

Towards addressing aggregation deviation for model training in resource-scarce edge environment

Collaborative Learning by Boosting in Distributed Environments

HCEC: An efficient geo-distributed deep learning training strategy based on wait-free back-propagation

A Transfer-Learning-Based Prognosis Prediction Paradigm That Bridges Data Distribution Shift Across EMR Datasets

A Fair and Efficient Hybrid Federated Learning Framework based on XGBoost for Distributed Power Prediction

STAFL: Staleness-Tolerant Asynchronous Federated Learning on Non-iid Dataset

Collaborative Deep Learning Across Multiple Data Centers

Predicting Collaborative Edits of Questions and Answers in Online Q&A Sites