Abstract:As Internet applications continue to scale up, microservice architecture has become increasingly popular due to its flexibility and logical structure. Anomaly detection in traces that record inter-microservice invocations is essential for diagnosing system failures. Deep learning-based approaches allow for accurate modeling of structural features (i.e., call paths) and latency features (i.e., call response time), which can determine the anomaly of a particular trace sample. However, the point-wise manner employed by these methods results in substantial system detection overhead and impracticality, given the massive volume of traces (billion-level). Furthermore, the point-wise approach lacks high-level information, as identical sub-structures across multiple traces may be encoded differently. In this paper, we introduce the first Group-wise Trace anomaly detection algorithm, named GTrace. This method categorizes the traces into distinct groups based on their shared sub-structure, such as the entire tree or sub-tree structure. A group-wise Variational AutoEncoder (VAE) is then employed to obtain structural representations. Moreover, the innovative "predicting latency with structure" learning paradigm facilitates the association between the grouped structure and the latency distribution within each group. With the group-wise design, representation caching, and batched inference strategies can be implemented, which significantly reduces the burden of detection on the system. Our comprehensive evaluation reveals that GTrace outperforms state-of-the-art methods in both performances (2.64% to 195.45% improvement in AUC metrics and 2.31% to 40.92% improvement in best F-Score) and efficiency (21.9x to 28.2x speedup). We have deployed and assessed the proposed algorithm on eBay's microservices cluster, and our code is available at https://github.com/NetManAIOps/GTrace.git.

Selecting Optimal Trace Clustering Pipelines with AutoML

Problem-oriented AutoML in Clustering

CLAMS: A System for Zero-Shot Model Selection for Clustering

A Survey on AutoML Methods and Systems for Clustering

Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities

From Point-wise to Group-wise: A Fast and Accurate Microservice Trace Anomaly Detection Approach

SKTR: Trace Recovery from Stochastically Known Logs

XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learning

STREAMLINE: A Simple, Transparent, End-To-End Automated Machine Learning Pipeline Facilitating Data Analysis and Algorithm Comparison

Data Pipeline Training: Integrating AutoML to Optimize the Data Flow of Machine Learning Models

Explainable AI-Based Ensemble Clustering for Load Profiling and Demand Response

Automated machine learning with dynamic ensemble selection

Using Suffix-Tree to Identify Patterns and Cluster Traces from Event Log.

Structural Feature Selection for Event Logs

Trace Encoding in Process Mining: a survey and benchmarking

Tracing and Visualizing Human-ML/AI Collaborative Processes through Artifacts of Data Work

FlowTracer: A Tool for Uncovering Network Path Usage Imbalance in AI Training Clusters

AutoEn: An AutoML method based on ensembles of predefined Machine Learning pipelines for supervised Traffic Forecasting

Selection and Application of Machine Learning- Algorithms in Production Quality

Traceable Automatic Feature Transformation via Cascading Actor-Critic Agents