Abstract:Effectively detecting run-time performance anomalies is crucial for clouds to identify abnormal performance behavior and forestall future incidents. To be used for real-world applications, an effective anomaly detection framework should meet three main challenging requirements: high accuracy for identifying anomalies, good robustness when application patterns change, and prediction ability for upcoming anomalies. Unfortunately, existing research about performance anomaly detection usually focuses on improving detection accuracy, while little research tackles the three challenges simultaneously. We conduct experiments for existing detection methods on multiple application monitoring data, and results show that existing detection methods usually focus on different features in data, which will lead to their diverse performance on different data patterns. Therefore, existing anomaly detection methods have difficulty improving detection accuracy and robustness and predicting anomalies. To address the three requirements, we propose an Ensemble Learning-Based Detection (ELBD) framework which integrates existing well-selected detection methods. The framework includes three classic linear ensemble methods (maximum, average, and weighted average) and a novel deep ensemble method. Our experiments show that the ELBD framework realizes better detection accuracy and robustness, where the deep ensemble method can achieve the most accurate and robust detection for cloud applications. In addition, it can predict anomalies in the next four minutes with an F1 score higher than 0.8. The paper also proposes a new indicator to measure detection accuracy, robustness, and multi-step prediction ability. The of the deep ensemble method is 5.1821, which is much higher than other detection methods.

Statistical Learning for Anomaly Detection in Cloud Server Systems: A Multi-Order Markov Chain Framework

A Novel System Anomaly Prediction System Based on Belief Markov Model and Ensemble Classification

Learning Multi-Pattern Normalities in the Frequency Domain for Efficient Time Series Anomaly Detection

Detecting Anomalous Behavior in Cloud Servers by Nested-Arc Hidden SEMI-Markov Model with State Summarization

Anomaly detecting and ranking of the cloud computing platform by multi-view learning

An Anomaly Detection Model Based on Cloud Model and Danger Theory.

Anomaly Detection for Virtualized Data Center Via Outlier Analysis

An Efficient Massive Log Discriminative Algorithm for Anomaly Detection in Cloud

Interactive Context-Aware Anomaly Detection Guided by User Feedback

LMHADC: Lightweight Method for Host Based Anomaly Detection in Cloud Using Mobile Agents

A Two-Layer Markov Chain Anomaly Detection Model

Anomaly Detection Based on a Dynamic Markov Model

Anomaly Secure Detection Methods by Analyzing Dynamic Characteristics of the Network Traffic in Cloud Communications

An Efficient Anomaly Detection Framework for Cloud Computing Environment

Synthetic Time Series for Anomaly Detection in Cloud Microservices

Research of Anomaly Detection Algorithm Based on Cloud Theory

Adaptive Anomaly Detection Strategy Based on Reinforcement Learning.

Robust and accurate performance anomaly detection and prediction for cloud applications: a novel ensemble learning-based framework

A Novel Anomaly Detection Approach for Mitigating Web-Based Attacks Against Clouds

A Novel Multi-Level Framework for Anomaly Detection in Time Series Data

Anomaly Detection Models Based on Context-Aware Sequential Long Short-Term Memory Learning.