Abstract:Autoencoder and conventional machine learning classifiers are widely used to design an intrusion detection system (IDS). However, noise and corruption in the high-dimensional network traffic samples will still affect the stability and performance of an autoencoder and other conventional machine learning based IDS models. The distortions in the input datasets cause deviations in the learnt patterns and always resulted in a low detection rate. Besides, the IDS classifiers use every single feature to train the samples, which makes the model consumes longer training time, computational resources and memory usage. The main aim of this proposal is to remove the distortions from the network traffic and train the IDS model in a faster manner to detect any category of intruders in the network traffic by achieving a higher detection rate in a short training time. To achieve this, we propose an intrusion detection system that combines a denoising autoencoder and LightGBM classifier. The denoising autoencoder removes the noise and corruptions in the network traffic, thereby possibly avoiding the deviations which can enhance the features learning capacity required for classification. Subsequently, to classify the samples, the LightGBM classifier is used. The classifier uses the feature histogram bins with larger gradients, thus avoiding using each feature at every iteration to accelerate the training speed and boost the predictive capacity of the model. The proposed model shows better detection performance improvement over nine benchmark datasets including CIDDS-001, CIDDS-002, ISCX-URL2016, UNSW-NB15, CIC-IDS-2017, ISCX-Tor2016, BoT-IoT, IoTID20 and Kyoto 2006+ for both binary classification and multi-classification tasks as compared to other existing IDS. The model achieves the maximum detection rate of over 99.60% for CIDDS-001, 99.90% for CIDDS-002, 97.00% for ISCX-Tor2016, 96.11% for UNSW-NB15, 99.86% for CIC-IDS17, 97.76% for ISCX-URL16, 99.91% for BoT-IoT, 97.43% for both IoTID2020 and Kyoto 2006+ datasets respectively, while the training time ranges from 1.10 to 21.78 s only. More importantly, the proposed model has higher learning and predictivity capacity which boosts the generalization capacity. The model also shows good performance in detecting all classes including the minority classes for all aforementioned datasets without any oversampling techniques. The efficiency of the model emphasizes that it can be deployed as a real-time model in any industrial network traffic that includes IoT based smart environment and fog-cloud computing network.

Artificial Intelligence based Network Intrusion Detection with hyper-parameter optimization tuning on the realistic cyber dataset CSE-CIC-IDS2018 using cloud computing

Artificial Intelligence outflanks all other machine learning classifiers in Network Intrusion Detection System on the realistic cyber dataset CSE-CIC-IDS2018 using cloud computing

Intrusion detection framework using auto‐metric graph neural network optimized with hybrid woodpecker mating and capuchin search optimization algorithm in IoT network

Design of Intrusion Detection System based on Cyborg intelligence for security of Cloud Network Traffic of Smart Cities

An Artificial Intelligence-based, Big Data-aware, Long-lasting Security Solution for the Internet of Things

A Hybrid Modified Deep Learning Architecture for Intrusion Detection System with Optimal Feature Selection

Attack classification in network intrusion detection system based on optimization strategy and deep learning methodology

A Scalable Network Intrusion Detection System using Bi-LSTM and CNN

Cyber Intrusion Detection Using Machine Learning Classification Techniques

CyberAIBot: Artificial Intelligence in an Intrusion Detection System for CyberSecurity in the IoT

Modular deep learning-based network intrusion detection architecture for real-world cyber-attack simulation

A Comparative Study of AI-based Intrusion Detection Techniques in Critical Infrastructures

Deep learning algorithms for intrusion detection systems in internet of things using CIC-IDS 2017 dataset

Advancing Network Security with AI: SVM-Based Deep Learning for Intrusion Detection

Enhancing Cybersecurity in Cloud Computing and WSNs: A Hybrid IDS Approach

Intelligent approach to build a Deep Neural Network based IDS for cloud environment using combination of machine learning algorithms

Toward Design of an Intelligent Cyber Attack Detection System using Hybrid Feature Reduced Approach for IoT Networks

A practical intrusion detection system based on denoising autoencoder and LightGBM classifier with improved detection performance

Generative AI and Cognitive Computing-Driven Intrusion Detection System in Industrial CPS

A New Intrusion Detection System for the Internet of Things via Deep Convolutional Neural Network and Feature Engineering

An integrated intrusion detection system using correlation‐based attribute selection and artificial neural network