Abstract:Microservice architecture has sprung up over recent years for managing enterprise applications, due to its ability to independently deploy and scale services. Despite its benefits, ensuring the reliability and safety of a microservice system remains highly challenging. Existing anomaly detection algorithms based on a single data modality (i.e., metrics, logs, or traces) fail to fully account for the complex correlations and interactions between different modalities, leading to false negatives and false alarms, whereas incorporating more data modalities can offer opportunities for further performance gain. As a fresh attempt, we propose in this paper a semi-supervised graph-based anomaly detection method, MSTGAD, which seamlessly integrates all available data modalities via attentive multi-modal learning. First, we extract and normalize features from the three modalities, and further integrate them using a graph, namely MST (microservice system twin) graph, where each node represents a service instance and the edge indicates the scheduling relationship between different service instances. The MST graph provides a virtual representation of the status and scheduling relationships among service instances of a real-world microservice system. Second, we construct a transformer-based neural network with both spatial and temporal attention mechanisms to model the inter-correlations between different modalities and temporal dependencies between the data points. This enables us to detect anomalies automatically and accurately in real-time. The source code of MSTGAD is publicly available at <a class="link-external link-https" href="https://github.com/alipay/microservice_system_twin_graph_based_anomaly_detection" rel="external noopener nofollow">this https URL</a>.

An Anomaly Detection Algorithm for Microservice Architecture Based on Robust Principal Component Analysis

MSCA: an Unsupervised Anomaly Detection System for Network Security in Backbone Network.

An Empirical Analysis of Anomaly Detection Methods for Multivariate Time Series

Practical Anomaly Detection over Multivariate Monitoring Metrics for Online Services

An effective parallel convolutional anomaly multi-classification model for fault diagnosis in microservice system

Unsupervised Detection of Microservice Trace Anomalies Through Service-Level Deep Bayesian Networks

Distributed Online One-Class Support Vector Machine for Anomaly Detection over Networks

An Intelligent Anomaly Detection Scheme for Micro-Services Architectures with Temporal and Spatial Data Analysis.

AutoMAP: Diagnose Your Microservice-based Web Applications Automatically.

Root-Cause Metric Location for Microservice Systems Via Log Anomaly Detection

Approach to Anomaly Detection in Microservice System with Multi-Source Data Streams

Robust Anomaly Detection for Multivariate Time Series Through Stochastic Recurrent Neural Network

Twin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System

Opprentice: Towards Practical And Automatic Anomaly Detection Through Machine Learning

Fast Anomaly Detection for IoT Services Based on Multi-source Log Fusion

Deep Attentive Anomaly Detection for Microservice Systems with Multimodal Time-Series Data

An Ensemble Approach for Detecting Anomalous User Behaviors

Anomaly Detection in Microservice-Based Systems

ServiceAnomaly: An anomaly detection approach in microservices using distributed traces and profiling metrics

Anomaly detection in microservice environments using distributed tracing data analysis and NLP

Microservice Anomaly Detection Based on Tracing Data Using Semi-supervised Learning