Abstract:Cloud infrastructures are designed to provide highly scalable, pay-as-per-use services to meet the performance requirements of users. The workload prediction of the cloud plays a crucial role in proactive auto-scaling and the dynamic management of resources to move toward fine-grained load balancing and job scheduling due to its ability to estimate upcoming workloads. However, due to users' diverse usage demands, the changing characteristics of workloads have become more and more complex, including not only short-term irregular fluctuation characteristics but also long-term dynamic variations. This prevents existing workload-prediction methods from fully capturing the above characteristics, leading to degradation of prediction accuracy. To deal with the above problems, this paper proposes a framework based on a dual-channel temporal convolutional network and transformer (referred to as DuCFF) to perform workload prediction. Firstly, DuCFF introduces data preprocessing technology to decouple different components implied by workload data and combine the original workload to form new model inputs. Then, in a parallel manner, DuCFF adopts the temporal convolution network (TCN) channel to capture local irregular fluctuations in workload time series and the transformer channel to capture long-term dynamic variations. Finally, the features extracted from the above two channels are further fused, and workload prediction is achieved. The performance of the proposed DuCFF's was verified on various workload benchmark datasets (i.e., ClarkNet and Google) and compared to its nine competitors. Experimental results show that the proposed DuCFF can achieve average performance improvements of 65.2%, 70%, 64.37%, and 15%, respectively, in terms of Mean Absolute Error (MAE), Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE) and R-squared (R2) compared to the baseline model CNN-LSTM.

A Novel Classification Model to Predict Batch Job Failures in Co-located Cloud

A Failure Detection Method for 3D LiDAR Based Localization

Cloud failure prediction based on traditional machine learning and deep learning

Analysis of Job Failure and Prediction Model for Cloud Computing Using Machine Learning

A Failure Prediction Approach Based on BiLSTM and Deep Feature Extractor for Hard Disk Drives.

Workload Failure Prediction for Data Centers

Resolution Matters: Revisiting Prediction-Based Job Co-location in Public Clouds

Predicting Scheduling Failures in the Cloud

Optimizing Resource Allocation for Data-Parallel Jobs Via GCN-Based Prediction

Online Job Failure Prediction in an HPC System

Feature Selection for Learning to Predict Outcomes of Compute Cluster Jobs with Application to Decision Support

Bioinformatics Computational Cluster Batch Task Profiling with Machine Learning for Failure Prediction

Online Job Scheduling in Distributed Machine Learning Clusters

Characteristics of Co-Allocated Online Services and Batch Jobs in Internet Data Centers: A Case Study From Alibaba Cloud.

Anomaly Analysis for Co-located Datacenter Workloads in the Alibaba Cluster

Failure prediction in production line based on federated learning: an empirical study

Online Scheduling Algorithm for Heterogeneous Distributed Machine Learning Jobs

A novel approach to workload prediction using attention-based LSTM encoder-decoder network in cloud environment

DuCFF: A Dual-Channel Feature-Fusion Network for Workload Prediction in a Cloud Infrastructure

Performance Analysis of Machine Learning Centered Workload Prediction Models for Cloud

Hunting Killer Tasks for Cloud System Through Machine Learning: A Google Cluster Case Study