Abstract:With the rapid advancement in network technologies, the need for cybersecurity has gained increasing momentum in recent years. As a primary defense mechanism, an intrusion detection system (IDS) is expected to adapt and secure the computing infrastructures from the ever-changing sophisticated threat landscape. Many deep learning approaches have recently been proposed; however, these techniques face significant challenges in identifying all types of attacks, especially rare attacks due to network traffic imbalances and the lack of a sufficient number of abnormal traffic samples for model training. To overcome these shortcomings and improve detection performance, this paper presents an unsupervised deep learning approach for intrusion detection. Unlike the existing IDS model that extracts features and trains a classifier in two separate stages, a single-stage IDS approach that integrates a one-dimensional convolutional autoencoder (1D CAE) and a one-class support vector machine (OCSVM) as a classifier into a joint optimization framework is introduced in this paper for the first time. Using only the normal traffic samples, the approach simultaneously optimizes the 1D CAE for compact feature representation and the OCSVM for classification by defining a unified objective function combining reconstruction error with classification error. Thus, the generated compact feature representation has not only reconstruction ability but also discriminative ability for classification. An in-depth ablation analysis validates the design decisions and provides further insight of the proposed approach. An extensive set of experiments on two benchmark intrusion datasets, NSL-KDD and UNSW-NB15, demonstrates the generalization ability of the proposed model for unseen attacks and confirms it as a competitive approach over the recent state-of-the-art intrusion detection baselines. Overall, the obtained results emphasize that the proposed approach has potential to serve as a baseline for building an effective IDS.

An Unsupervised Two-Layer Multi-Step Network Attack Detector

A Dynamic Intrusion Detection System Capable of Detecting Unknown Attacks

Multi-agent based hybrid Intrusion detection system

An alert correlating algorithm based on multi-step attack path graphs:MSACA

Multi-Step Attack Detection Based on Pre-Trained Hidden Markov Models

Anomaly based multi-stage attack detection method

Unsupervised deep learning approach for network intrusion detection combining convolutional autoencoder and one-class SVM

SEDAT: A Stacked Ensemble Learning-Based Detection Model for Multiscale Network Attacks

MAAC: Novel Alert Correlation Method To Detect Multi-step Attack

Introducing a New Alert Data Set for Multi-Step Attack Analysis

Learning to Detect: A Data-driven Approach for Network Intrusion Detection

Network Anomaly Intrusion Detection Based on Deep Learning Approach

A novel hierarchical attention-based triplet network with unsupervised domain adaptation for network intrusion detection

DualNet: Locate Then Detect Effective Payload with Deep Attention Network

A Network Intrusion Detection System Using Hybrid Multilayer Deep Learning Model

A New Multistage Approach to Detect Subtle DDoS Attacks.

Hybrid CNN-LSTM model combined with feature selection and SMOTE for detection of network attacks

Host-Based Network Intrusion Detection via Feature Flattening and Two-stage Collaborative Classifier

Three layer hybrid learning to improve intrusion detection system performance

Dynamic Threshold-based Two-layer Online Unsupervised Anomaly Detector

Network intrusion detection using oversampling technique and machine learning algorithms