Abstract:Cloud systems, which are typical cyber–physical systems, consist of physical nodes and virtualized facilities that collaborate to fulfill cloud computing services. The advent of visualization technology engenders resource sharing and service parallelism in cloud services, introducing novel challenges to system modeling. In this study, we construct a systematic model that concurrently evaluates system reliability, performance, and power consumption (PC) while delineating cloud service disruptions arising from random hardware and software failures. Initially, we depict system states using a birth–death process that accommodates resource sharing and service parallelism. Given the relatively concise service duration and regular failure distributions, we employ transient-state transition probabilities instead of steady-state analysis. The birth–death process effectively links system reliability, performance, and PC through service durations governed by service assignment decisions and failure/repair distributions. Subsequently, we devise a multistage sample path randomization method to estimate system metrics and other factors related to service availability. The findings highlight that the trade-off between performance and PC, under the umbrella of reliability guarantees, hinges on the equilibrium between service duration and unit power. To further delve into the subject, we formulate optimization models for service assignment and juxtapose optimal decisions under varying availability scenarios, workload levels, and service attributes. Numerical results indicate that service parallelism can improve performance and conserve energy when the workload remains moderate. However, as the workload escalates, the repercussions of resource sharing-induced performance loss become more pronounced due to resource capacity limitations. In cases where system availability is constrained, resource sharing should be approached cautiously to ensure adherence to deadline requirements. This study theoretically analyzes the interrelations among system reliability, performance, and PC, offering valuable insights for making informed decisions in cloud service assignments.

Leveraging Deep Learning to Improve Performance Predictability in Cloud Microservices with Seer.

Seer: Leveraging Big Data to Navigate the Complexity of Performance Debugging in Cloud Microservices.

Microservice Auto-Scaling Algorithm Based on Workload Prediction in Cloud-Edge Collaboration Environment

Seer: leveraging big data to navigate the complexity of cloud debugging

Sage: Leveraging ML to Diagnose Unpredictable Performance in Cloud Microservices

CloudProphet: A Machine Learning-Based Performance Prediction for Public Clouds

Smart VM Co-Scheduling with the Precise Prediction of Performance Characteristics

Modelling cloud service latency and availability using a deep learning strategy

Sage: Using Unsupervised Learning for Scalable Performance Debugging in Microservices

Dynamic Microservice Deployment and Offloading for Things-Edge-Cloud Computing

A performance prediction scheme for computation-intensive applications on cloud

Service-Oriented Reliability Modeling and Autonomous Optimization of Reliability for Public Cloud Computing Systems

Why does Prediction Accuracy Decrease over Time? Uncertain Positive Learning for Cloud Failure Prediction

Performance Analysis of Machine Learning Centered Workload Prediction Models for Cloud

Enhancing the Analysis of Software Failures in Cloud Computing Systems with Deep Learning

Cloud-integrated cyber–physical systems: Reliability, performance and power consumption with shared-servers and parallelized services

DeepScaler: Holistic Autoscaling for Microservices Based on Spatiotemporal GNN with Adaptive Graph Learning

Forecasting Workload in Cloud Computing: Towards Uncertainty-Aware Predictions and Transfer Learning

EsDNN: Deep Neural Network based Multivariate Workload Prediction Approach in Cloud Environment

Performance Optimization for Cloud Computing Systems in the Microservice Era: State-of-the-art and Research Opportunities.

Robust and accurate performance anomaly detection and prediction for cloud applications: a novel ensemble learning-based framework