Poster Abstract: DVFO: Dynamic Voltage, Frequency and Offloading for Efficient AI on Edge Devices

Ziyang Zhang,Yang Zhao,Jie. Liu
DOI: https://doi.org/10.1145/3583120.3589819
2023-01-01
Abstract:Due to resource constraints, it is challenging to optimize the inference performance in terms of energy consumption and latency on edge devices. In this paper, we leverage both the dynamic voltage frequency scaling (DVFS) technique and edge-cloud collaborative inference to minimize the overall energy consumption. We propose a deep reinforcement learning (DRL)-based method called DVFO to jointly optimize 1) CPU, GPU and memory frequencies, and 2) the ratio of offloaded feature maps in edge-cloud collaboration. Preliminary experimental results show that DVFO reduces the average energy consumption by 33% compared to the baselines. Moreover, it reduces the inference latency by more than 54%.
What problem does this paper attempt to address?