Edge Computing Sleep Mode Task Scheduling Based on Deep Reinforcement Learning

Shengkun Tao,Fanping Zeng,Yufan Tao,Pengcheng Xia,Tong Liu
DOI: https://doi.org/10.1109/bigcom61073.2023.00039
2023-01-01
Abstract:In edge computing, computing, storage, and network services are provided at the edge of the network. If the edge server is configured with the appropriate virtualization services, end-device requests can be processed at the edge to save network bandwidth and reduce response time. It is necessary for edge devices to run for a long period of time in order to receive user requests, however, users do not always send requests, which may result in some edge devices being idle for a long time and causing a significant amount of idle energy consumption.In this paper, we design a sleep-mode based edge computing architecture that uses containers as resource units. Also, based on the proximal policy optimization algorithm (PPO), we propose a task scheduling algorithm using this edge computing architecture, namely Proximal Policy Optimization Task Scheduling based on Sleep Mode (PPO-TSSM). Our goal is to minimize the total utility of the task; where the total utility is the tradeoff between completion time, energy consumption and deadline. The experimental results show that our proposed algorithm PPO-TSSM reduces the total cost by at least 3.33% (up to 62.92%) compared with the baseline algorithm, and reduces the minimum completion time by 5.37% to 157.7%, and the energy consumption by 2.95% to 8.97% compared with other baseline algorithms. Meanwhile, we set up PPO-TS-NS without sleep mode to compare with the environment using sleep mode, and find that PPO-TSSM reduces the energy consumption by 74.76% compared with PPO-TS-NS, while the minimum completion time only increases by 5.33%. Therefore, introducing sleep mode can effectively reduce the cost of the whole edge computing system.
What problem does this paper attempt to address?