Abstract:Under the organization of the base station (BS), wireless federated learning (FL) enables collaborative model training among multiple devices. However, the BS is merely responsible for aggregating local updates during the training process, which incurs a waste of the computational resource at the BS. To tackle this issue, we propose a semi-federated learning (SemiFL) paradigm to leverage the computing capabilities of both the BS and devices for a hybrid implementation of centralized learning (CL) and FL. Specifically, each device sends both local gradients and data samples to the BS for training a shared global model. To improve communication efficiency over the same time-frequency resources, we integrate over-the-air computation for aggregation and non-orthogonal multiple access for transmission by designing a novel transceiver structure. To gain deep insights, we conduct convergence analysis by deriving a closed-form optimality gap for SemiFL and extend the result to two extra cases. In the first case, the BS uses all accumulated data samples to calculate the CL gradient, while a decreasing learning rate is adopted in the second case. Our analytical results capture the destructive effect of wireless communication and show that both FL and CL are special cases of SemiFL. Then, we formulate a non-convex problem to reduce the optimality gap by jointly optimizing the transmit power and receive beamformers. Accordingly, we propose a two-stage algorithm to solve this intractable problem, in which we provide the closed-form solutions to the beamformers. Extensive simulation results on two real-world datasets corroborate our theoretical analysis, and show that the proposed SemiFL outperforms conventional FL and achieves 3.2% accuracy gain on the MNIST dataset compared to state-of-the-art benchmarks.

Training A Semantic Communication System with Federated Learning

An Efficient Federated Learning Framework for Training Semantic Communication System

Federated Semantic Learning Driven by Information Bottleneck for Task-Oriented Communications

Message Passing Based Wireless Federated Learning Via Analog Message Aggregation

A Multi-user Deep Semantic Communication System based on Federated Learning with Dynamic Model Aggregation

Asynchronous Federated Learning over Wireless Communication Networks.

FSSC: Federated Learning of Transformer Neural Networks for Semantic Image Communication

A Generalized Look at Federated Learning: Survey and Perspectives

Federated Learning Powered Semantic Communication for UAV Swarm Cooperation

Federated Learning with Unsourced Random Access.

Federated Learning-Based Cooperative Model Training for Task-Oriented Semantic Communication

Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspective

A Communication-efficient Federated Learning Assisted by Central Data: Implementation of Vertical Training into Horizontal Federated Learning

Federated Contrastive Learning for Personalized Semantic Communication

Personalized Federated Learning for Generative AI-Assisted Semantic Communications

Federated Learning for Image Semantic Communication System Based on CNN and Transformer

Federated Learning for Audio Semantic Communication

CELLM: An Efficient Communication in Large Language Models Training for Federated Learning

Communication-Efficient Learning of Deep Networks from Decentralized Data

Semi-Federated Learning: Convergence Analysis and Optimization of A Hybrid Learning Framework