Abstract:The rapid development of Internet technology has brought great convenience to our production life, and the ensuing security problems have become increasingly prominent. These problems threaten users' privacy and pose significant security risks to the normal conduct of many aspects of society, such as politics, economy, culture, and people's livelihood. The growth of the information transmission rate expands the scope of attacks and provides a more attack environment for intruders. Abnormal detection is an effective security protection technology that can monitor network transmission in real-time, effectively sense external attacks, and provide response decisions for relevant managers. The development of machine learning has also led to the development of abnormal traffic detection technology. The goal has been to use powerful and fast learning algorithms to deal with changing threats and respond in real-time. Most of the current abnormal detection research is based on simulation, using public and well-known datasets. On the one hand, the dataset contains high-dimensional massive data, which traditional machine learning methods cannot be processed. On the other hand, the labeled data scale is far behind the application requirements, and the dataset's labels are all manually labeled, so the labeling cost is exceptionally high. This paper proposes a semi-supervised Double Deep Q-Network (SSDDQN)-based optimization method for network abnormal traffic detection, mainly based on Double Deep Q-Network (DDQN), a representative of Deep Reinforcement Learning algorithm. In SSDDQN, the current network first adopts the autoencoder to reconstruct the traffic features and then uses a deep neural network as a classifier. The target network first uses the unsupervised learning algorithm K-Means clustering and then uses deep neural network prediction. The experiment uses NSL-KDD and AWID datasets for training and testing and -erforms a comprehensive comparison with existing machine learning models. The experimental results show that SSDDQN has certain advantages in time complexity and achieved good results in various evaluation metrics.

A novel detection model for abnormal network traffic based on bidirectional temporal convolutional network

Abnormal Network Traffic Detection Algorithm Based on Improved Convolutional Neural Network

CBF-IDS: Addressing Class Imbalance Using CNN-BiLSTM with Focal Loss in Network Intrusion Detection System

Abnormal Traffic Detection Based on Attention and Big Step Convolution

Intrusion Detection Model Using Temporal Convolutional Network Blend Into Attention Mechanism

Network Abnormal Traffic Detection Model Based on Semi-Supervised Deep Reinforcement Learning

Abnormal Traffic Detection for Internet of Things Based on an Improved Residual Network

Efficient Deep CNN-BiLSTM Model for Network Intrusion Detection

TGA: A Novel Network Intrusion Detection Method Based on TCN, BiGRU and Attention Mechanism

Intrusion Detection Using Temporal Convolutional Networks

Real-Time Detection of Network Traffic Anomalies in Big Data Environments Using Deep Learning Models

A Network Security Situation Prediction Method through the Use of Improved TCN and BiDLSTM

An Industrial Intrusion Detection Method Based on Hybrid Convolutional Neural Networks with Improved TCN

L2-BiTCN-CNN: Spatio-temporal features fusion-based multi-classification model for various internet applications identification

A Network Traffic anomaly Detection method based on CNN and XGBoost

Network Intrusion Traffic Detection Based on Feature Extraction

Unified model for collective and point anomaly detection using stacked temporal convolution networks

Network Anomaly Intrusion Detection Based on Deep Learning Approach

A Network Intrusion Detection Model Based on BiLSTM with Multi-Head Attention Mechanism

MTC-NET: A Multi-Channel Independent Anomaly Detection Method for Network Traffic

An abnormal driving behavior recognition algorithm based on the temporal convolutional network and soft thresholding