Abstract:In existing federated learning (FL), the base station (BS) coordinates devices to collaboratively train a shared model by avoiding the transmission of raw data. To achieve communication-efficient model uploading, over-the-air computation (AirComp) is often employed to aggregate model parameters. However, in conventional AirComp assisted FL, the BS’s abundant computation resources are underutilized due to its non-involvement in model training. Meanwhile, transmission failures resulting from fluctuating wireless channels impair the quality of model aggregation. In this paper, we propose a retransmissionbased semi-federated learning (SemiFL) framework, wherein devices upload model parameters and public privacy-free data for enabling a hybrid implementation of FL and centralized learning (CL). In our new framework, the BS leverages its abundant computation resources to aid CL model training, which mitigates the resource wastage while alleviating local computational burden of devices. Moreover, the proposed new retransmission mechanism effectively overcomes detrimental transmission failures resulting from the fluctuating quasi-static channel, aiming to guarantee improved learning performance of SemiFL. Successful transmission probabilities of both retransmission-based AirComp and retransmission-based digital communication are provided in closed forms. To attain deep insights, we derive an optimality gap to capture the convergence behavior of retransmission-based SemiFL. Then, we formulate a non-convex long-term problem to minimize a weighted sum of overall latency and energy consumption by jointly optimizing communication, computation, and learning parameters. Extensive experimental results show that our retransmission-based SemiFL obtains 21.9%, 30.5%, and 44.1% accuracy gains on three datasets, while efficaciously reducing latency and energy consumption compared to benchmarks. Meanwhile, our scheme enhances learning performance on the fluctuating quasi-static channel compared to state-of-the-art schemes.

Convergence Analysis and Latency Minimization for Retransmission-Based Semi-Federated Learning

Retransmission-Based Semi-Federated Learning

Semi-Federated Learning: Convergence Analysis and Optimization of A Hybrid Learning Framework

Convergence Analysis and Latency Minimization for Semi-Federated Learning in Massive IoT Networks

Semi-Federated Learning: an Integrated Framework for Pervasive Intelligence in 6G Networks.

Federated Learning in Multi-RIS-Aided Systems

Adaptive Batchsize Selection and Gradient Compression for Wireless Federated Learning

Over-the-air Learning Rate Optimization for Federated Learning

Latency Minimization for Wireless Federated Learning with Heterogeneous Local Model Updates

Convergence Analysis of Semi-Federated Learning with Non-IID Data

Latency-Efficient Wireless Federated Learning with Spasification and Quantization for Heterogeneous Devices

SemiFL: Semi-Federated Learning Empowered by Simultaneously Transmitting and Reflecting Reconfigurable Intelligent Surface

Asynchronous Federated Learning over Wireless Communication Networks.

Adaptive Modulation for Wireless Federated Learning

Convergence Analysis and Optimization of Over-the-Air Federated Meta-Learning.

Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks

Delay Minimization for Federated Learning Over Wireless Communication Networks

Latency Aware Semi-synchronous Client Selection and Model Aggregation for Wireless Federated Learning

Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation

Vertical Federated Learning over Cloud-RAN: Convergence Analysis and System Optimization

Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation