Abstract:Intrusion Detection Systems (IDSs) play a crucial role in safeguarding network infrastructures from cyber threats and ensuring the integrity of highly sensitive data. Conventional IDS technologies, although successful in achieving high levels of accuracy, frequently encounter substantial model bias. This bias is primarily caused by imbalances in the data and the lack of relevance of certain features. This study aims to tackle these challenges by proposing an advanced machine learning (ML) based IDS that minimizes misclassification errors and corrects model bias. As a result, the predictive accuracy and generalizability of the IDS are significantly improved. The proposed system employs advanced feature selection techniques, such as Recursive Feature Elimination (RFE), sequential feature selection (SFS), and statistical feature selection, to refine the input feature set and minimize the impact of non-predictive attributes. In addition, this work incorporates data resampling methods such as Synthetic Minority Oversampling Technique and Edited Nearest Neighbor (SMOTE_ENN), Adaptive Synthetic Sampling (ADASYN), and Synthetic Minority Oversampling Technique–Tomek Links (SMOTE_Tomek) to address class imbalance and improve the accuracy of the model. The experimental results indicate that our proposed model, especially when utilizing the random forest (RF) algorithm, surpasses existing models regarding accuracy, precision, recall, and F Score across different data resampling methods. Using the ADASYN resampling method, the RF model achieves an accuracy of 99.9985% for botnet attacks and 99.9777% for Man-in-the-Middle (MITM) attacks, demonstrating the effectiveness of our approach in dealing with imbalanced data distributions. This research not only improves the abilities of IDS to identify botnet and MITM attacks but also provides a scalable and efficient solution that can be used in other areas where data imbalance is a recurring problem. This work has implications beyond IDS, offering valuable insights into using ML techniques in complex real-world scenarios.

Group Feature Selection Via Structural Sparse Logistic Regression for IDS

Network Intrusion Detection Through Discriminative Feature Selection by Using Sparse Logistic Regression

A Novel Method for Feature Learning and Network Intrusion Classification

Intrusion detection system over real-time data traffic using machine learning methods with feature selection approaches

Relevant Feature Selection Model Using Data Mining for Intrusion Detection System

Sparsity-based Feature Selection for Anomalous Subgroup Discovery

Performance Analysis of Intrusion Detection Systems Using a Feature Selection Method on the UNSW-NB15 Dataset

ID-RDRL: a deep reinforcement learning-based feature selection intrusion detection model

Impact of Feature Selection Methods on Data Classification for IDS

Statistical methods for feature selection: unlocking the key to improved accuracy

Novel Framework for an Intrusion Detection System Using Multiple Feature Selection Methods Based on Deep Learning

Enhancing network security with information-guided-enhanced Runge Kutta feature selection for intrusion detection

A Machine Learning-Based Framework with Enhanced Feature Selection and Resampling for Improved Intrusion Detection

An improved NSGA-III algorithm for feature selection used in intrusion detection

Effective Feature Extraction for Intrusion Detection System using Non-negative Matrix Factorization and Univariate analysis

χ 2-BidLSTM: A Feature Driven Intrusion Detection System Based on χ 2 Statistical Model and Bidirectional LSTM

Intrusion detection system using classification algorithms with feature selection mechanism over real-time data traffic

Supervised Feature Selection Techniques in Network Intrusion Detection: a Critical Review

XAI-based Feature Selection for Improved Network Intrusion Detection Systems

Feature selection for intrusion detection systems

Feature Selection for Intrusion Detection Using Random Forest