Abstract:Autoencoder and conventional machine learning classifiers are widely used to design an intrusion detection system (IDS). However, noise and corruption in the high-dimensional network traffic samples will still affect the stability and performance of an autoencoder and other conventional machine learning based IDS models. The distortions in the input datasets cause deviations in the learnt patterns and always resulted in a low detection rate. Besides, the IDS classifiers use every single feature to train the samples, which makes the model consumes longer training time, computational resources and memory usage. The main aim of this proposal is to remove the distortions from the network traffic and train the IDS model in a faster manner to detect any category of intruders in the network traffic by achieving a higher detection rate in a short training time. To achieve this, we propose an intrusion detection system that combines a denoising autoencoder and LightGBM classifier. The denoising autoencoder removes the noise and corruptions in the network traffic, thereby possibly avoiding the deviations which can enhance the features learning capacity required for classification. Subsequently, to classify the samples, the LightGBM classifier is used. The classifier uses the feature histogram bins with larger gradients, thus avoiding using each feature at every iteration to accelerate the training speed and boost the predictive capacity of the model. The proposed model shows better detection performance improvement over nine benchmark datasets including CIDDS-001, CIDDS-002, ISCX-URL2016, UNSW-NB15, CIC-IDS-2017, ISCX-Tor2016, BoT-IoT, IoTID20 and Kyoto 2006+ for both binary classification and multi-classification tasks as compared to other existing IDS. The model achieves the maximum detection rate of over 99.60% for CIDDS-001, 99.90% for CIDDS-002, 97.00% for ISCX-Tor2016, 96.11% for UNSW-NB15, 99.86% for CIC-IDS17, 97.76% for ISCX-URL16, 99.91% for BoT-IoT, 97.43% for both IoTID2020 and Kyoto 2006+ datasets respectively, while the training time ranges from 1.10 to 21.78 s only. More importantly, the proposed model has higher learning and predictivity capacity which boosts the generalization capacity. The model also shows good performance in detecting all classes including the minority classes for all aforementioned datasets without any oversampling techniques. The efficiency of the model emphasizes that it can be deployed as a real-time model in any industrial network traffic that includes IoT based smart environment and fog-cloud computing network.

A feature selection method based on auto-encoder for internet of things intrusion detection

Deep Autoencoder-Based Integrated Model for Anomaly Detection and Efficient Feature Extraction in IoT Networks

Effective combining of feature selection techniques for machine learning-enabled IoT intrusion detection

Multiple-Input Auto-Encoder Guided Feature Selection for IoT Intrusion Detection Systems

A novel hybrid autoencoder and modified particle swarm optimization feature selection for intrusion detection in the internet of things network

Using Feature Selection Enhancement to Evaluate Attack Detection in the Internet of Things Environment

A New Intrusion Detection System for the Internet of Things via Deep Convolutional Neural Network and Feature Engineering

Feature engineering and deep learning-based intrusion detection framework for securing edge IoT

Approach for Detecting Attacks on IoT Networks Based on Ensemble Feature Selection and Deep Learning Models

Optimized common features selection and deep-autoencoder (OCFSDA) for lightweight intrusion detection in Internet of things

Constrained Twin Variational Auto-Encoder for Intrusion Detection in IoT Systems

Ensemble technique of intrusion detection for IoT-edge platform

A Novel Feature-Selection Algorithm in IoT Networks for Intrusion Detection

Optimized intrusion detection in IoT and fog computing using ensemble learning and advanced feature selection

Intrusion Detection in Industrial Internet of Things Network-Based on Deep Learning Model with Rule-Based Feature Selection

Stacked Autoencoder-based Intrusion Detection System to Combat Financial Fraudulent

A practical intrusion detection system based on denoising autoencoder and LightGBM classifier with improved detection performance

Feature Extraction for Machine Learning-based Intrusion Detection in IoT Networks

An efficient intrusion detection system for IoT security using CNN decision forest

Improved Crow Search-Based Feature Selection and Ensemble Learning for IoT Intrusion Detection

An efficient deep recurrent neural network for detection of cyberattacks in realistic IoT environment