Energy-efficient VM Scheduling Based on Deep Reinforcement Learning

Bin Wang,Fagui Liu,Weiwei Lin
DOI: https://doi.org/10.1016/j.future.2021.07.023
IF: 7.307
2021-01-01
Future Generation Computer Systems
Abstract:Achieving data center resource optimization and QoS guarantee driven by high energy efficiency has become a research hotspot. However, QoS information directly sampled from the cloud environment will inevitably be affected by a small amount of structured noise. This paper proposes a deep reinforcement learning model based on QoS feature learning to optimize data center resource scheduling. In the deep learning stage, we propose a QoS feature learning method based on improved stacked denoising autoencoders to extract more robust QoS characteristic information. In the reinforcement learning stage, we propose a multi-power machines (PMs) collaborative resource scheduling algorithm based on reinforcement learning. Extensive experiments show that compared with other excellent resource scheduling strategies, our method can effectively reduce the energy consumption of cloud data centers while maintaining the lowest service level agreement (SLA) violation rate. A good balance is achieved between energy-saving and QoS optimization.
What problem does this paper attempt to address?