Offloading DNN Tasks Based on Graph Reinforcement Learning in Client-Edge-Cloud Environment

Mingchu Li,Junhao Huang,Zhihua Wang
DOI: https://doi.org/10.1109/ijcnn60899.2024.10650388
2024-01-01
Abstract:With the increasing focus on the applications of artificial intelligence (AI), the number of layers and neurons in deep neural networks (DNN) is rapidly increasing, requiring a large amount of computational resources to execute DNN inference tasks. In order to address the resource bottleneck of the terminal device(TD) and achieve better user satisfaction at the terminal, DNN partitioning is explored in the client-edge-cloud (CEC) joint computing environment. The combination offloading decision of DNN sub-layers and the strong coupling between task execution is a mixed-integer programming (MIP) problem, making it particularly difficult to solve. To address this issue, we propose the graph reinforcement learning based DNN tasks offloading (GRLDO) scheme. Firstly, the CEC is modeled as a graph, and offloading strategies are performed through graph state transitions. Then, GRLDO combines GNN with the actor-critic network to train unlabeled offloading decision makers. In addition, to effectively train GRLDO, we propose a method for rapidly exploring action spaces and approaching the optimal solution. Numerical results show that, for various types of DNN tasks, this approach achieves up to 99.7% optimal performance, demonstrating better user satisfaction than existing algorithms.
What problem does this paper attempt to address?