Abstract:Workload prediction plays a crucial role in resource management of large scale cloud datacenters. Although quite a number of methods/algorithms have been proposed, long-term changes have not been explicitly identified and considered. Due to shifty user demands, workload re-locations, or other reasons, the "resource usage pattern" of a workload, which is usually quite stable in a short-term view, may change dynamically in a long-term range. Such long-term dynamic changes may cause significant accuracy degradation for prediction algorithms. How to handle such long-term dynamic changes is an open and challenging issue. In this article, we propose Evolution Graph for Workload Prediction (EvoGWP), a novel method that can predict long-term dynamic changes using a delicately designed graph-based evolution learning algorithm. EvoGWP automatically extracts shapelets to explicitly identify resource usage patterns of workloads in a fine-grained level, and predicts workload changes by considering factors in both temporal and spatial dimensions. We design a two-level importance based shapelet extraction mechanism to mine new usage pattern changes in temporal dimension, and design a novel evolution graph model to fuse the interference among resource usage patterns of different workloads in spatial dimension. By combining temporal extraction of shapelets from each single workload and spatial interference of shapelets among different workloads, we then design a spatio-temporal GNN-based encoder-decoder model to predict the long-term dynamic changes of workloads. Experiments using real trace data from Alibaba, Tencent and Google show that EvoGWP improves the prediction accuracy by up to 58.6% over the state-of-the-art prediction methods. Moreover, EvoGWP can outperform the state-of-the-art prediction methods in terms of model convergence. To the best of our knowledge, this is the first work that explicitly identifies fine-grained workload resource usage patterns to accurately predict long-term dynamic changes of workloads.

EvoGWP: Predicting Long-Term Changes in Cloud Workloads Using Deep Graph-Evolution Learning

Forecasting resource usage pattern changes in clouds via contrast graph-evolution learning

EsDNN: Deep Neural Network based Multivariate Workload Prediction Approach in Cloud Environment

ELASTIC: Edge Workload Forecasting Based on Collaborative Cloud-Edge Deep Learning

One for All: Unified Workload Prediction for Dynamic Multi-tenant Edge Cloud Platforms

A novel approach to workload prediction using attention-based LSTM encoder-decoder network in cloud environment

Cloud Workload Turning Points Prediction via Cloud Feature-Enhanced Deep Learning

E2LG: a multiscale ensemble of LSTM/GAN deep learning architecture for multistep-ahead cloud workload prediction

A Collaborative Cloud-Edge Approach for Robust Edge Workload Forecasting

PePNet: A Periodicity-Perceived Workload Prediction Network Supporting Rare Occurrence of Heavy Workload

GRU-ES: Resource Usage Prediction of Cloud Workloads Using a Novel Hybrid Method.

Evolutionary Neural Network Modeling for Energy Prediction of Cloud Data Centers

Multiscale Representation Enhanced Temporal Flow Fusion Model for Long-Term Workload Forecasting

TEALED: A Multi-Step Workload Forecasting Approach Using Time-Sensitive EMD and Auto LSTM Encoder-Decoder

Long Short Term Memory Recurrent Neural Network (LSTM-RNN) Based Workload Forecasting Model For Cloud Datacenters

Three-Way Ensemble Prediction for Workload in the Data Center

Long-Term CPU Load Prediction

Multi-step-ahead Host Load Prediction with GRU Based Encoder-Decoder in Cloud Computing

A feature extraction and time warping based neural expansion architecture for cloud resource usage forecasting

Workload prediction based on improved error correlation logistic regression algorithm and Cross‐TRCN of spatiotemporal neural network

FinOps-driven optimization of cloud resource usage for high-performance computing using machine learning