Abstract:Cellular-connected unmanned aerial vehicle (UAV) with flexible deployment is foreseen to be a major part of the sixth generation (6G) networks. The UAVs connected to the base station (BS), as aerial users (UEs), could exploit machine learning (ML) algorithms to provide a wide range of advanced applications, like object detection and video tracking. Conventionally, the ML model training is performed at the BS, known as centralized learning (CL), which causes high communication overhead due to the transmission of large datasets, and potential concerns about UE privacy. To address this, distributed learning algorithms, including federated learning (FL) and split learning (SL), were proposed to train the ML models in a distributed manner via only sharing model parameters. FL requires higher computational resource on the UE side than SL, while SL has larger communication overhead when the local dataset is large. To effectively train an ML model considering the diversity of UEs with different computational capabilities and channel conditions, we first propose a novel distributed learning architecture, a hybrid split and federated learning (HSFL) algorithm by reaping the parallel model training mechanism of FL and the model splitting structure of SL. We then provide its convergence analysis under non-independent and identically distributed (non-IID) data with random UE selection scheme. By conducting experiments on training two ML models, Net and AlexNet, in wireless UAV networks, our results demonstrate that the HSFL algorithm achieves higher learning accuracy than FL and less communication overhead than SL under IID and non-IID data, and the learning accuracy of HSFL algorithm increases with the increasing number of the split training UEs. We further propose a Multi-Arm Bandit (MAB) based best channel (BC) and best 2-norm (BN2) (MAB-BC-BN2) UE selection scheme to select the UEs with better wireless channel quality and larger local model updates for model training in eac- round. Numerical results demonstrate it achieves higher learning accuracy than BC, MAB-BC and MAB-BN2 UE selection scheme under non-IID, Dirichlet-nonIID and Dirichlet-Imbalanced data.

Hybrid Architectures for Distributed Machine Learning in Heterogeneous Wireless Networks

Distributed Machine Learning in D2D-Enabled Heterogeneous Networks: Architectures, Performance, and Open Challenges

Hierarchical Federated Learning: the Interplay of User Mobility and Data Heterogeneity

Wireless Distributed Learning: A New Hybrid Split and Federated Learning Approach

Joint Client Scheduling and Wireless Resource Allocation for Heterogeneous Federated Edge Learning with Non-IID Data

Cluster-HSFL: A Cluster-Based Hybrid Split and Federated Learning.

Enhanced Hybrid Hierarchical Federated Edge Learning Over Heterogeneous Networks

Privacy and Efficiency of Communications in Federated Split Learning

Optimization Design for Federated Learning in Heterogeneous 6G Networks

Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications

A Novel Hierarchically Decentralized Federated Learning Framework in 6G Wireless Networks.

Towards Scalable Wireless Federated Learning: Challenges and Solutions

Analysis and Optimization of Wireless Federated Learning with Data Heterogeneity

Data-Heterogeneous Hierarchical Federated Learning with Mobility

Hierarchically Federated Learning in Wireless Networks: D2D Consensus and Inter-Cell Aggregation

PPSFL: Privacy-Preserving Split Federated Learning for heterogeneous data in edge-based Internet of Things

HSFL: Efficient and Privacy-Preserving Offloading for Split and Federated Learning in IoT Services

Privacy-Preserving Federated Learning for Data Heterogeneity in 6G Mobile Networks

Distributed Link Heterogeneity Exploitation for Attention-Weighted Robust Federated Learning in 6G Networks

On Safeguarding Privacy and Security in the Framework of Federated Learning

HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients