Abstract:Network traffic anomaly detection is a key step in identifying and preventing network security threats. This study aims to construct a new deep-learning-based traffic anomaly detection model through in-depth research on new feature-engineering methods, significantly improving the efficiency and accuracy of network traffic anomaly detection. The specific research work mainly includes the following two aspects: 1. In order to construct a more comprehensive dataset, this article first starts from the raw data of the classic traffic anomaly detection dataset UNSW-NB15 and combines the feature extraction standards and feature calculation methods of other classic detection datasets to re-extract and design a feature description set for the original traffic data in order to accurately and completely describe the network traffic status. We reconstructed the dataset DNTAD using the feature-processing method designed in this article and conducted evaluation experiments on it. Experiments have shown that by verifying classic machine learning algorithms, such as XGBoost, this method not only does not reduce the training performance of the algorithm but also improves its operational efficiency. 2. This article proposes a detection algorithm model based on LSTM and the recurrent neural network self-attention mechanism for important time-series information contained in the abnormal traffic datasets. With this model, through the memory mechanism of the LSTM, the time dependence of traffic features can be learned. On the basis of LSTM, a self-attention mechanism is introduced, which can weight the features at different positions in the sequence, enabling the model to better learn the direct relationship between traffic features. A series of ablation experiments were also used to demonstrate the effectiveness of each component of the model. The experimental results show that, compared to other comparative models, the model proposed in this article achieves better experimental results on the constructed dataset.

Attention-based Encoder-Decoder Recurrent Neural Networks for HTTP Payload Anomaly Detection

Packet Payload Based Anomalous Network Intrusion Detection

Detecting Anomalies In Encrypted Traffic Via Deep Dictionary Learning

Auto-AD: Autonomous Hyperspectral Anomaly Detection Network Based on Fully Convolutional Autoencoder

ADSAD: An unsupervised attention-based discrete sequence anomaly detection framework for network security analysis

Anomaly-Based Web Attack Detection: A Deep Learning Approach

Anomaly-Based Web Attack Detection

Deep anomaly detection in packet payload

Network Traffic Anomaly Detection Using Recurrent Neural Networks

Research on Anomaly Network Detection Based on Self-Attention Mechanism

Reconstruction-based LSTM-Autoencoder for Anomaly-based DDoS Attack Detection over Multivariate Time-Series Data

ADA: Adaptive Deep Log Anomaly Detector

Abnormal Traffic Detection: Traffic Feature Extraction and DAE-GAN With Efficient Data Augmentation

Relative Frequency-Rank Encoding for Unsupervised Network Anomaly Detection

Improved AutoEncoder with LSTM module and KL divergence

ARCADE: Adversarially Regularized Convolutional Autoencoder for Network Anomaly Detection

EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos

Detecting Web Attacks From HTTP Weblogs Using Variational LSTM Autoencoder Deviation Network

A Comparative Evaluation of AutoEncoder-Based Unsupervised Anomaly Detection Methods Applied on Space Payload

Network Anomaly Intrusion Detection Based on Deep Learning Approach

Application of Improved Asynchronous Advantage Actor Critic Reinforcement Learning Model on Anomaly Detection