Abstract:In today's information age, with the rapid development of network technology and a large number of applications of sensors in daily life. The number of various types of data has shown a great growth. These data not only bring us convenience and benefits, but also pose a great challenge to us, that is, how to explore the information of the data and effectively analyze the specific significance contained in the data has become a hot research direction. In the large amount of data obtained, most of the data are in the normal state and only represent the basic "value" information. Compared with the data in the normal state, the information carried by a small part of the data is more worthy of attention. The emergence of these data is the so-called "exception". The occurrence of exceptions indicates that the system that should be running normally has changed, and these changes often have a negative impact on the system. Looking at these applications, it is not difficult to find that the actual frequency of these anomalies accounts for a very small proportion compared with a large number of normal time, but its value is very huge. Therefore, real-time online anomaly detection of convective data has very important value and significance for scientific research and industrial application. In the process of this research, I have a more comprehensive and detailed understanding of the research field of "anomaly detection of stream data" through theoretical learning, apply the deep learning model to anomaly detection of stream data, and test the performance of the model through experiments. By comparing the performance of traditional anomaly detection algorithms, unsupervised and semi supervised machine learning models and neural networks such as LSTM/HTM in stream data anomaly detection, we try to find an algorithm that can detect stream data information in real time and provide anomaly alarm in time.

Towards Online Anomaly Detection by Combining Multiple Detection Methods and Storm

Understanding and Handling Alert Storm for Online Service Systems

An efficient method for online detecting abnormal cascading pattern in distributed networks

Analysis and Prediction of Big Stream Data in Real-Time Water Quality Monitoring System.

Anomaly detection of power grid data based on storm cloud platform sliding window

Anomaly Detection of Large Scale Network Based on Data Streams

Big Data Real-Time Processing Based on Storm

Micro-cluster-based Online Network Abnormal Detection Method

Statically Defend Network Consumption Against Acker Failure Vulnerability in Storm

Online Network traffic anomaly detection method combining OS-ELM and SADE

Online System Problem Detection by Mining Patterns of Console Logs

Learning the feature distribution similarities for online time series anomaly detection

Anomaly Detection of Streaming Data Based on Deep Learning

Detecting Anomalous Users via Streaming Data Processing in Smart Grid

Online Monitoring of Big Data Streams: A Rank-Based Sampling Algorithm by Data Augmentation

Online Pattern Matching and Prediction of Incoming Alarm Floods

Approach to Anomaly Detection in Microservice System with Multi-Source Data Streams

An Integrated Method for Anomaly Detection From Massive System Logs.

Practical Anomaly Detection over Multivariate Monitoring Metrics for Online Services

Research on the detection of abnormal traffic for multi-channel network

An Adaptive Online Scheme for Scheduling and Resource Enforcement in Storm.