Abstract:Given the rise in demand for cloud computing in the modern era, the effectiveness of resource utilization is eminent to decrease energy footprint and achieve economic services. With the emerging machine learning and artificial intelligence techniques to model and predict, it is essential to explore a principal method that provides the best solution for the accurate provisioning of forthcoming requests in a cloud data center. Recent studies used machine learning and other advanced analytics to predict resource usage; however, these do not consider long-range dependencies in the time series, which is essential to capture for better prediction. Further, they show limitations in handling noise, missing values, and outliers in datasets. In this paper, we explored the problem by studying three techniques that enabled us to answer improvements in short-term forecasting of physical machines' resource usage if the above factors are considered. We evaluated the predictions using Transformer and Informer deep learning models that cover the above aspects and compared them with the Long short-term memory (LSTM) model. We used a real-world Google cluster trace usage dataset and employed Balanced Iterative Reducing and Clustering using Hierarchies (BIRCH) algorithm to select heterogeneous machines. The evaluation of the three models depicts that the Transformer architecture that considers long-range dependencies in time series and shortcomings with datasets shows improvement in forecasting with 14.2% reduction in RMSE than LSTM. However, LSTM shows better results for some machines than the Transformer, which depicts the importance of input sequence order. The Informer model, which considers both dependencies and is a hybrid of LSTM and Transformer, outperformed both models with 21.7% from LSTM and 20.8% from Transformer reduction in RMSE. The results also depict Informer model consistently performs better than the other models across all subsets of the dataset. Our study proves that considering long-range dependencies and sequence ordering for resource usage time series improves the prediction.

Towards Deep Industrial Transfer Learning: Clustering for Transfer Case Selection

Online Differentiable Clustering for Intent Learning in Recommendation.

Deep Learning for Industrial Image: Challenges, Methods for Enriching the Sample Space and Restricting the Hypothesis Space, and Possible Issue

A Comprehensive Survey of Deep Transfer Learning for Anomaly Detection in Industrial Time Series: Methods, Applications, and Directions

Deep learning‐based clustering of processes and their visual exploration: An industry 4.0 use case for small, medium‐sized enterprises

Transfer Learning as an Enabler of the Intelligent Digital Twin

Characterising User Transfer Amid Industrial Resource Variation: A Bayesian Nonparametric Approach

A deep targeted transfer network with clustering pseudo-label learning for fault diagnosis across different Machines

A Survey on Deep Industrial Transfer Learning in Fault Prognostics

An effective deep learning architecture leveraging BIRCH clustering for resource usage prediction of heterogeneous machines in cloud data center

Identification of Industrial Process Time Series Events Based on Agglomerative Hierarchical Clustering*

Adaptive Transfer Clustering: A Unified Framework

Profile Decomposition based Hybrid Transfer Learning for Cold-start Data Anomaly Detection

A Clustering multi-stage training transfer learning framework for Cross simulation domain and experimental domain fault diagnosis

Making costly manufacturing smart with transfer learning under limited data: A case study on composites autoclave processing

Transferable Automl By Model Sharing Over Grouped Datasets

Time Series Prediction Method of Industrial Process With Limited Data Based on Transfer Learning

Industrial Applications of Transfer Learning Methods for Aircraft Propulsion Systems

Learning the Shared Subspace for Multi-task Clustering and Transductive Transfer Classification.

Learning More with Less Data in Manufacturing: The Case of Turning Tool Wear Assessment through Active and Transfer Learning

A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence