Abstract:Slow task detection is a critical problem in cloud operation and maintenance since it is highly related to user experience and can bring substantial liquidated damages. Most anomaly detection methods detect it from a single-task aspect. However, considering millions of concurrent tasks in large-scale cloud computing clusters, it becomes impractical and inefficient. Moreover, single-task slowdowns are very common and do not necessarily indicate a malfunction of a cluster due to its violent fluctuation nature in a virtual environment. Thus, we shift our attention to cluster-wide task slowdowns by utilizing the duration time distribution of tasks across a cluster, so that the computation complexity is not relevant to the number of tasks. The task duration time distribution often exhibits compound periodicity and local exceptional fluctuations over time. Though transformer-based methods are one of the most powerful methods to capture these time series normal variation patterns, we empirically find and theoretically explain the flaw of the standard attention mechanism in reconstructing subperiods with low amplitude when dealing with compound periodicity. To tackle these challenges, we propose SORN (i.e., Skimming Off subperiods in descending amplitude order and Reconstructing Non-slowing fluctuation), which consists of a Skimming Attention mechanism to reconstruct the compound periodicity and a Neural Optimal Transport module to distinguish cluster-wide slowdowns from other exceptional fluctuations. Furthermore, since anomalies in the training set are inevitable in a practical scenario, we propose a picky loss function, which adaptively assigns higher weights to reliable time slots in the training set. Extensive experiments demonstrate that SORN outperforms state-of-the-art methods on multiple real-world industrial datasets.

Hunting Killer Tasks for Cloud System through Behavior Pattern Learning

Hunting Killer Tasks for Cloud System Through Machine Learning: A Google Cluster Case Study

Analysis of Frequently Failing Tasks and Rescheduling Strategy in the Cloud System

Time Series Based Killer Task Online Recognition Service: A Google Cluster Case Study

Task Scheduling in Cloud Computing Based on The Cuckoo Search Algorithm

Visual Analysis of Cloud Computing Performance Using Behavioral Lines

Testing Tasks Management in Testing Cloud Environment

Predicting Scheduling Failures in the Cloud

Evaluating Performance Of Rescheduling Strategies In Cloud System

Cluster-Wide Task Slowdown Detection in Cloud System

Overview of Task Scheduling Algorithms in Cloud Computing

Modeling and Analyzing Cost and Utilization Based Task Scheduling for Cloud Application

Research on Task Allocation and Resource Scheduling Method in Cloud Environment

A Task Scheduling Strategy in Cloud Computing Environment

Modeling and Analyzing Dynamic Fault-Tolerant Strategy for Deadline Constrained Task Scheduling in Cloud Computing.

Two-level Task Scheduling with Multi-Objectives in Geo-Distributed and Large-Scale SaaS Cloud

Hybrid Cloud Adaptive Scheduling Strategy for Heterogeneous Workloads

Scheduling Multi-Skill Technicians and Reassignable Tasks in a Cloud Computing Company

A Task Scheduling Method For Energy-Performance Trade-Off In Clouds

Task Scheduling and Resource Allocation Based on Ant-Colony Optimization and Deep Reinforcement Learning

Many-Objective Cloud Task Scheduling.