TPTO: A Transformer-PPO based Task Offloading Solution for Edge Computing Environments

Niloofar Gholipour,Marcos Dias de Assuncao,Pranav Agarwal,julien gascon-samson,Rajkumar Buyya

2023-12-19

Abstract:Emerging applications in healthcare, autonomous vehicles, and wearable assistance require interactive and low-latency data analysis services. Unfortunately, cloud-centric architectures cannot fulfill the low-latency demands of these applications, as user devices are often distant from cloud data centers. Edge computing aims to reduce the latency by enabling processing tasks to be offloaded to resources located at the network's edge. However, determining which tasks must be offloaded to edge servers to reduce the latency of application requests is not trivial, especially if the tasks present dependencies. This paper proposes a DRL approach called TPTO, which leverages Transformer Networks and PPO to offload dependent tasks of IoT applications in edge computing. We consider users with various preferences, where devices can offload computation to an edge server via wireless channels. Performance evaluation results demonstrate that under fat application graphs, TPTO is more effective than state-of-the-art methods, such as Greedy, HEFT, and MRLCO, by reducing latency by 30.24%, 29.61%, and 12.41%, respectively. In addition, TPTO presents a training time approximately 2.5 times faster than an existing DRL approach.

Distributed, Parallel, and Cluster Computing

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper aims to address the task offloading problem in edge computing environments, specifically:

1. **Low Latency Requirements**: Emerging applications (such as healthcare, autonomous vehicles, and wearable devices) require interactive and low-latency data analysis services. However, traditional cloud-centric architectures cannot meet these low-latency requirements because user devices are often far from cloud data centers.

2. **Task Offloading Optimization**: Edge computing reduces latency by offloading data processing tasks to servers at the network edge. However, determining which tasks should be offloaded to edge servers to reduce the latency of application requests is not easy, especially when there are dependencies between tasks.

To address the above issues, the paper proposes a deep reinforcement learning-based method—TPTO (Transformer-PPO based Task Offloading), which utilizes Transformer networks and the Proximal Policy Optimization (PPO) algorithm to offload dependent tasks in IoT applications. Experimental results show that in complex application graphs, TPTO significantly reduces latency compared to other existing methods (such as Greedy, HEFT, and MRLCO) and also has faster training times. Additionally, TPTO demonstrates the ability to effectively handle task offloading in dynamic environments, performing well under different transmission rates and topologies.