Abstract:Network traffic anomaly detection is a key step in identifying and preventing network security threats. This study aims to construct a new deep-learning-based traffic anomaly detection model through in-depth research on new feature-engineering methods, significantly improving the efficiency and accuracy of network traffic anomaly detection. The specific research work mainly includes the following two aspects: 1. In order to construct a more comprehensive dataset, this article first starts from the raw data of the classic traffic anomaly detection dataset UNSW-NB15 and combines the feature extraction standards and feature calculation methods of other classic detection datasets to re-extract and design a feature description set for the original traffic data in order to accurately and completely describe the network traffic status. We reconstructed the dataset DNTAD using the feature-processing method designed in this article and conducted evaluation experiments on it. Experiments have shown that by verifying classic machine learning algorithms, such as XGBoost, this method not only does not reduce the training performance of the algorithm but also improves its operational efficiency. 2. This article proposes a detection algorithm model based on LSTM and the recurrent neural network self-attention mechanism for important time-series information contained in the abnormal traffic datasets. With this model, through the memory mechanism of the LSTM, the time dependence of traffic features can be learned. On the basis of LSTM, a self-attention mechanism is introduced, which can weight the features at different positions in the sequence, enabling the model to better learn the direct relationship between traffic features. A series of ablation experiments were also used to demonstrate the effectiveness of each component of the model. The experimental results show that, compared to other comparative models, the model proposed in this article achieves better experimental results on the constructed dataset.

Robust Regression for Anomaly Detection.

Robust Anomaly Detection for Time-series Data

Robust Anomaly Detection for Multivariate Time Series Through Stochastic Recurrent Neural Network

A Rough Set Theory Based Method for Anomaly Intrusion Detection in Computer Network Systems

Robust Log-Based Anomaly Detection on Unstable Log Data

An Effective Method for Computer Network Anomaly Detection

Anomaly Detection by Robust Statistics

Develop End-to-End Anomaly Detection System

A network anomaly detection algorithm based on semi-supervised learning and adaptive multiclass balancing

Optimal Classification-based Anomaly Detection with Neural Networks: Theory and Practice

Multivariate Time Series Anomaly Detection with Few Positive Samples

Unsupervised Anomaly Detection by Robust Density Estimation

A Network Traffic anomaly Detection method based on CNN and XGBoost

Research on Network Security Filtering Model and Key Algorithms Based on Network Abnormal Traffic Analysis

A New Anomaly Detection Method Based on IGTE and IGFE.

Rectifying inaccurate unsupervised learning for robust time series anomaly detection

Anomaly detection in wide area network mesh using two machine learning anomaly detection algorithms

Research on Anomaly Network Detection Based on Self-Attention Mechanism

Log-Based Anomaly Detection With Robust Feature Extraction and Online Learning

Network Anomaly Detection and Localization

Anomaly-Based Web Attack Detection: A Deep Learning Approach