Abstract:As Internet applications continue to scale up, microservice architecture has become increasingly popular due to its flexibility and logical structure. Anomaly detection in traces that record inter-microservice invocations is essential for diagnosing system failures. Deep learning-based approaches allow for accurate modeling of structural features (i.e., call paths) and latency features (i.e., call response time), which can determine the anomaly of a particular trace sample. However, the point-wise manner employed by these methods results in substantial system detection overhead and impracticality, given the massive volume of traces (billion-level). Furthermore, the point-wise approach lacks high-level information, as identical sub-structures across multiple traces may be encoded differently. In this paper, we introduce the first Group-wise Trace anomaly detection algorithm, named GTrace. This method categorizes the traces into distinct groups based on their shared sub-structure, such as the entire tree or sub-tree structure. A group-wise Variational AutoEncoder (VAE) is then employed to obtain structural representations. Moreover, the innovative "predicting latency with structure" learning paradigm facilitates the association between the grouped structure and the latency distribution within each group. With the group-wise design, representation caching, and batched inference strategies can be implemented, which significantly reduces the burden of detection on the system. Our comprehensive evaluation reveals that GTrace outperforms state-of-the-art methods in both performances (2.64% to 195.45% improvement in AUC metrics and 2.31% to 40.92% improvement in best F-Score) and efficiency (21.9x to 28.2x speedup). We have deployed and assessed the proposed algorithm on eBay's microservices cluster, and our code is available at https://github.com/NetManAIOps/GTrace.git.

Scalable Comparison of JavaScript V8 Bytecode Traces

Static JavaScript Call Graphs: A Comparative Study

Juicing V8: A primary account for the memory forensics of the V8 JavaScript engine

Automatic Tracing in Task-Based Runtime Systems

TraceSim: A Method for Calculating Stack Trace Similarity

Scalable and Accurate Binary Search Method Based on Simhash and Partial Trace

A Scalable and Near-Optimal Conformance Checking Approach for Long Traces

Whose baseline compiler is it anyway?

ATOS: Adaptive Program Tracing with Online Control Flow Graph Support

Improving the Effectiveness of Traceability Link Recovery using Hierarchical Bayesian Networks

Trex: Learning Execution Semantics from Micro-Traces for Binary Similarity

From Point-wise to Group-wise: A Fast and Accurate Microservice Trace Anomaly Detection Approach

ARCTURUS : Full Coverage Binary Similarity Analysis with Reachability-Guided Emulation

Concolic Testing of JavaScript using Sparkplug

TraceTracker: Hardware/Software Co-Evaluation for Large-Scale I/O Workload Reconstruction

StrTune: Data Dependence-based Code Slicing for Binary Similarity Detection with Fine-tuned Representation

StacerBot: A Stacktrace Search Engine for Stack Overflow

Scalable Isolation of Failure-Inducing Changes Via Version Comparison.

Amalgamating different JIT compilations in a meta-tracing JIT compiler framework

Refactoring-aware Block Tracking in Commit History

StackSight: Unveiling WebAssembly through Large Language Models and Neurosymbolic Chain-of-Thought Decompilation