Abstract:Network traffic anomaly detection is a key step in identifying and preventing network security threats. This study aims to construct a new deep-learning-based traffic anomaly detection model through in-depth research on new feature-engineering methods, significantly improving the efficiency and accuracy of network traffic anomaly detection. The specific research work mainly includes the following two aspects: 1. In order to construct a more comprehensive dataset, this article first starts from the raw data of the classic traffic anomaly detection dataset UNSW-NB15 and combines the feature extraction standards and feature calculation methods of other classic detection datasets to re-extract and design a feature description set for the original traffic data in order to accurately and completely describe the network traffic status. We reconstructed the dataset DNTAD using the feature-processing method designed in this article and conducted evaluation experiments on it. Experiments have shown that by verifying classic machine learning algorithms, such as XGBoost, this method not only does not reduce the training performance of the algorithm but also improves its operational efficiency. 2. This article proposes a detection algorithm model based on LSTM and the recurrent neural network self-attention mechanism for important time-series information contained in the abnormal traffic datasets. With this model, through the memory mechanism of the LSTM, the time dependence of traffic features can be learned. On the basis of LSTM, a self-attention mechanism is introduced, which can weight the features at different positions in the sequence, enabling the model to better learn the direct relationship between traffic features. A series of ablation experiments were also used to demonstrate the effectiveness of each component of the model. The experimental results show that, compared to other comparative models, the model proposed in this article achieves better experimental results on the constructed dataset.

A framework for end-to-end deep learning-based anomaly detection in transportation networks

A Hybrid Deep Learning Approach for Driver Anomalous Lane Changing Identification

Real-Time Detection of Network Traffic Anomalies in Big Data Environments Using Deep Learning Models

Research on Anomaly Network Detection Based on Self-Attention Mechanism

Anomaly Detection in Traffic Surveillance Videos with GAN-based Future Frame Prediction

Passenger flow anomaly detection in urban rail transit networks with graph convolution network-informer and Gaussian Bayes models

Improved LSTM-based Time-Series Anomaly Detection in Rail Transit Operation Environments

Deep learning detection of anomalous patterns from bus trajectories for traffic insight analysis

Detecting Urban Traffic Anomalies Using Traffic-Monitoring Data

A Novel Approach of Traffic Congestion and Anomaly Detection with Prediction Using Deep Learning

Data-Driven Detection of Anomalies and Cascading Failures in Traffic Networks

ETLNet: An Efficient TCN-BiLSTM Network for Road Anomaly Detection Using Smartphone Sensors

Anomaly Detection in Connected and Autonomous Vehicle Trajectories Using LSTM Autoencoder and Gaussian Mixture Model

Variational LSTM Enhanced Anomaly Detection for Industrial Big Data

A Survey on Anomaly Detection for Technical Systems using LSTM Networks

A Framework of Abnormal Behavior Detection and Classification Based on Big Trajectory Data for Mobile Networks

Anomaly Detection in Road Networks Using Sliding-Window Tensor Factorization

Pattern and Anomaly Detection in Urban Temporal Networks

Transformer-based Spatio-Temporal Unsupervised Traffic Anomaly Detection in Aerial Videos

Anomalous Motion Detection on Highway Using Deep Learning

Good Practices and A Strong Baseline for Traffic Anomaly Detection