Abstract:With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden for network edge clients. However, existing SFL frameworks would frequently upload smashed data and download gradients between the server and each client, leading to severe communication overheads. To address this issue, this work proposes a novel communication-and-computation efficient SFL framework, which allows dynamic model splitting (server- and client-side model cutting point selection) and broadcasting of aggregated smashed data gradients. We theoretically analyze the impact of the cutting point selection on the convergence rate of the proposed framework, revealing that model splitting with a smaller client-side model size leads to a better convergence performance and vise versa. Based on the above insights, we formulate an optimization problem to minimize the model convergence rate and latency under the consideration of data privacy via a joint Cutting point selection, Communication and Computation resource allocation (CCC) strategy. To deal with the proposed mixed integer nonlinear programming optimization problem, we develop an algorithm by integrating the Double Deep Q-learning Network (DDQN) with convex optimization methods. Extensive experiments validate our theoretical analyses across various datasets, and the numerical results demonstrate the effectiveness and superiority of the proposed communication-efficient SFL compared with existing schemes, including parallel split learning and traditional SFL mechanisms.

Split Learning in Wireless Networks: A Communication and Computation Adaptive Scheme

Efficient Communication-Computation Tradeoff for Split Computing: A Multi-Tier Deep Reinforcement Learning Approach

Efficient Partitioning and Communication Scheme-Based Distributed Edge Computing to Accelerate Deep Neural Network

Accelerating Split Federated Learning over Wireless Communication Networks

Adaptive Split Learning over Energy-Constrained Wireless Edge Networks

Split Learning Over Wireless Networks: Parallel Design and Resource Management

Learning-Based Multi-Tier Split Computing for Efficient Convergence of Communication and Computation

An Efficient Split Learning Framework for Recurrent Neural Network in Mobile Edge Environment.

Federated Split Learning for Edge Intelligence in Resource-Constrained Wireless Networks

Dynamic Encoding and Decoding of Information for Split Learning in Mobile-Edge Computing: Leveraging Information Bottleneck Theory

Adaptive Layer Splitting for Wireless LLM Inference in Edge Computing: A Model-Based Reinforcement Learning Approach

Energy Efficient Semantic Communication over Wireless Networks with Rate Splitting

Over-the-Air Split Machine Learning in Wireless MIMO Networks.

Federated Split Learning with Model Pruning and Gradient Quantization in Wireless Networks

Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networks

Communication-and-Computation Efficient Split Federated Learning: Gradient Aggregation and Resource Management

Optimum splitting computing for DNN training through next generation smart networks: a multi-tier deep reinforcement learning approach

Adaptive Compression-Aware Split Learning and Inference for Enhanced Network Efficiency

Dynamic Split Computing for Efficient Deep EDGE Intelligence

Online Node Selection Strategy for SplitFed Learning in Mobile Communication