Abstract:In existing federated learning (FL), the base station (BS) coordinates devices to collaboratively train a shared model by avoiding the transmission of raw data. To achieve communication-efficient model uploading, over-the-air computation (AirComp) is often employed to aggregate model parameters. However, in conventional AirComp assisted FL, the BS’s abundant computation resources are underutilized due to its non-involvement in model training. Meanwhile, transmission failures resulting from fluctuating wireless channels impair the quality of model aggregation. In this paper, we propose a retransmissionbased semi-federated learning (SemiFL) framework, wherein devices upload model parameters and public privacy-free data for enabling a hybrid implementation of FL and centralized learning (CL). In our new framework, the BS leverages its abundant computation resources to aid CL model training, which mitigates the resource wastage while alleviating local computational burden of devices. Moreover, the proposed new retransmission mechanism effectively overcomes detrimental transmission failures resulting from the fluctuating quasi-static channel, aiming to guarantee improved learning performance of SemiFL. Successful transmission probabilities of both retransmission-based AirComp and retransmission-based digital communication are provided in closed forms. To attain deep insights, we derive an optimality gap to capture the convergence behavior of retransmission-based SemiFL. Then, we formulate a non-convex long-term problem to minimize a weighted sum of overall latency and energy consumption by jointly optimizing communication, computation, and learning parameters. Extensive experimental results show that our retransmission-based SemiFL obtains 21.9%, 30.5%, and 44.1% accuracy gains on three datasets, while efficaciously reducing latency and energy consumption compared to benchmarks. Meanwhile, our scheme enhances learning performance on the fluctuating quasi-static channel compared to state-of-the-art schemes.

Convergence Analysis of Semi-Federated Learning with Non-IID Data

Semi-Federated Learning for Connected Intelligence With Computing-Heterogeneous Devices

Semi-Federated Learning: Convergence Analysis and Optimization of A Hybrid Learning Framework

Convergence Analysis and Latency Minimization for Semi-Federated Learning in Massive IoT Networks

Hierarchical Federated Learning: the Interplay of User Mobility and Data Heterogeneity

Semi-Federated Learning for Internet of Intelligence

Semi-Federated Learning for Collaborative Intelligence in Massive IoT Networks

Semi-Federated Learning: an Integrated Framework for Pervasive Intelligence in 6G Networks.

Convergence Analysis and System Design for Federated Learning over Wireless Networks.

Convergence Analysis and Design Principle for Federated Learning in Wireless Network.

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Convergence Analysis and Latency Minimization for Retransmission-Based Semi-Federated Learning

SemiFL: Semi-Federated Learning Empowered by Simultaneously Transmitting and Reflecting Reconfigurable Intelligent Surface

Federated Learning with Non-IID Data: A Survey

Federated Learning in Multi-RIS-Aided Systems

A Survey of Federated Learning on Non-IID Data

FedSR: A Semi-Decentralized Federated Learning Algorithm for Non-IIDness in IoT System

Joint User Association and Resource Allocation for Wireless Hierarchical Federated Learning with IID and Non-IID Data

Information-Exchangeable Hierarchical Clustering for Federated Learning with Non-IID Data

Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced data

Retransmission-Based Semi-Federated Learning