Abstract:Mobile edge computing (MEC) has emerged as a promising paradigm to enable computation-intensive and latency-sensitive mobile applications by offloading tasks to proximal edge servers. This paper proposes a novel federated reinforcement learning framework called Transformer-based Federated Soft Actor-Critic (TFSAC) to address a joint computation offloading and resource scheduling problem in a CPU-GPU heterogeneous MEC network while preserving privacy. Specifically, a graph attention network (GAT) extracts high-dimensional features from the task dependency graph. Rather than simply averaging weights, TFSAC applies transformer encoders to learn contextual relationships between agents and enable selective aggregation of relevant knowledge during federated model training to preserve agents’ privacy. Experiments on real-world trace data demonstrate TFSAC’s superiority over benchmarks in maximizing quality-of-service (QoS) across configurations.

Distributed Dependent Task Offloading in CPU-GPU Heterogenous MEC: A Federated Reinforcement Learning Approach