Abstract:In existing federated learning (FL), the base station (BS) coordinates devices to collaboratively train a shared model by avoiding the transmission of raw data. To achieve communication-efficient model uploading, over-the-air computation (AirComp) is often employed to aggregate model parameters. However, in conventional AirComp assisted FL, the BS’s abundant computation resources are underutilized due to its non-involvement in model training. Meanwhile, transmission failures resulting from fluctuating wireless channels impair the quality of model aggregation. In this paper, we propose a retransmissionbased semi-federated learning (SemiFL) framework, wherein devices upload model parameters and public privacy-free data for enabling a hybrid implementation of FL and centralized learning (CL). In our new framework, the BS leverages its abundant computation resources to aid CL model training, which mitigates the resource wastage while alleviating local computational burden of devices. Moreover, the proposed new retransmission mechanism effectively overcomes detrimental transmission failures resulting from the fluctuating quasi-static channel, aiming to guarantee improved learning performance of SemiFL. Successful transmission probabilities of both retransmission-based AirComp and retransmission-based digital communication are provided in closed forms. To attain deep insights, we derive an optimality gap to capture the convergence behavior of retransmission-based SemiFL. Then, we formulate a non-convex long-term problem to minimize a weighted sum of overall latency and energy consumption by jointly optimizing communication, computation, and learning parameters. Extensive experimental results show that our retransmission-based SemiFL obtains 21.9%, 30.5%, and 44.1% accuracy gains on three datasets, while efficaciously reducing latency and energy consumption compared to benchmarks. Meanwhile, our scheme enhances learning performance on the fluctuating quasi-static channel compared to state-of-the-art schemes.

Semi-Federated Learning: an Integrated Framework for Pervasive Intelligence in 6G Networks.

Semi-Federated Learning: Convergence Analysis and Optimization of A Hybrid Learning Framework

Retransmission-Based Semi-Federated Learning

Semi-Federated Learning for Connected Intelligence With Computing-Heterogeneous Devices

Convergence Analysis of Semi-Federated Learning with Non-IID Data

Asynchronous Federated Learning over Wireless Communication Networks.

Convergence Analysis and Latency Minimization for Retransmission-Based Semi-Federated Learning

SemiFL: Semi-Federated Learning Empowered by Simultaneously Transmitting and Reflecting Reconfigurable Intelligent Surface

Integrated Sensing, Communication and Computation for Over-the-Air Federated Learning in 6G Wireless Networks

Semi-Federated Learning for Internet of Intelligence

Semi-Federated Learning for Edge Intelligence with Imperfect SIC

Federated Learning with Unsourced Random Access.

Federated Learning in Multi-RIS-Aided Systems

Convergence Analysis and Latency Minimization for Semi-Federated Learning in Massive IoT Networks

Federated Learning for 6G: Applications, Challenges, and Opportunities

A Joint Learning and Communications Framework for Federated Learning over Wireless Networks

Semi-Federated Learning for Collaborative Intelligence in Massive IoT Networks

Learning to Transmit with Provable Guarantees in Wireless Federated Learning

Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission

Over-the-Air Hierarchical Personalized Federated Learning

A Novel Hierarchically Decentralized Federated Learning Framework in 6G Wireless Networks.