Abstract:Massive key performance indicators (KPIs) are monitored as multivariate time series data (MTS) to ensure the reliability of the software applications and service system. Accurately detecting the abnormality of MTS is very critical for subsequent fault elimination. The scarcity of anomalies and manual labeling has led to the development of various self-supervised MTS anomaly detection (AD) methods, which optimize an overall objective/loss encompassing all metrics' regression objectives/losses. However, our empirical study uncovers the prevalence of conflicts among metrics' regression objectives, causing MTS models to grapple with different losses. This critical aspect significantly impacts detection performance but has been overlooked in existing approaches. To address this problem, by mimicking the design of multi-gate mixture-of-experts (MMoE), we introduce CAD, a Conflict-aware multivariate KPI Anomaly Detection algorithm. CAD offers an exclusive structure for each metric to mitigate potential conflicts while fostering inter-metric promotions. Upon thorough investigation, we find that the poor performance of vanilla MMoE mainly comes from the input-output misalignment settings of MTS formulation and convergence issues arising from expansive tasks. To address these challenges, we propose a straightforward yet effective task-oriented metric selection and p&s (personalized and shared) gating mechanism, which establishes CAD as the first practicable multi-task learning (MTL) based MTS AD model. Evaluations on multiple public datasets reveal that CAD obtains an average F1-score of 0.943 across three public datasets, notably outperforming state-of-the-art methods. Our code is accessible at <a class="link-external link-https" href="https://github.com/dawnvince/MTS_CAD" rel="external noopener nofollow">this https URL</a>.

Situation-Aware Multivariate Time Series Anomaly Detection Through Active Learning and Contrast VAE-Based Models in Large Distributed Systems

Practical Approach to Asynchronous Multivariate Time Series Anomaly Detection and Localization

Multivariate time series anomaly detection with variational autoencoder and spatial–temporal graph network

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

CANet: Convolutional Attention-based Network for Multivariate Time Series Anomaly Detection

An Empirical Analysis of Anomaly Detection Methods for Multivariate Time Series

Multi-Scale Time Series Ensemble Learning for Information System Anomaly Detection

LARA: A Light and Anti-overfitting Retraining Approach for Unsupervised Time Series Anomaly Detection

An adversarial contrastive autoencoder for robust multivariate time series anomaly detection

An Extreme Learning Machine for Unsupervised Online Anomaly Detection in Multivariate Time Series

Revisiting VAE for Unsupervised Time Series Anomaly Detection: A Frequency Perspective

Anomaly Detection for Time Series Using VAE-LSTM Hybrid Model

MELODY: Robust Semi-Supervised Hybrid Model for Entity-Level Online Anomaly Detection with Multivariate Time Series

An Evaluation of Anomaly Detection and Diagnosis in Multivariate Time Series

Multivariate Time Series Anomaly Detection with Few Positive Samples

Self-Supervised Variational Graph Autoencoder for System-Level Anomaly Detection

HybridAD: A Hybrid Model-Driven Anomaly Detection Approach for Multivariate Time Series

HCL-MTSAD: Hierarchical Contrastive Consistency Learning for Accurate Detection of Industrial Multivariate Time Series Anomalies

Beyond Sharing: Conflict-Aware Multivariate Time Series Anomaly Detection

Efficient Multivariate Time Series Anomaly Detection Through Transfer Learning for Large-Scale Web Services

Multivariate Time Series Anomaly Detection: Fancy Algorithms and Flawed Evaluation Methodology