Abstract:Computer networks rely on Intrusion Detection Systems (IDSs) and Intrusion Prevention Systems (IPSs) to ensure the security, reliability, and availability of an organization. In recent years, various approaches were developed and implemented to create effective IDSs and IPSs. This paper specifically focuses on IDSs that utilize Machine Learning (ML) techniques for improved accuracy. ML-based IDSs have verified to be successful in discovering network attacks. However, their performance tends to decline when dealing with high-dimensional data spaces. It is essential to develop a suitable feature extraction strategy that could identify and remove irrelevant features that do not significantly classification process to address this issue. Additionally, many ML-based IDSs exhibit high false positive rates and poor detection accuracy when trained on unbalanced datasets. In this study, we analyze the UNSW-NB15 IDS, which will serve as the training and testing data for our models. In order to reduce the feature space and improve the efficiency of our analysis, we leverage a filter-based feature reduction method utilizing the Pearson correlation coefficient algorithm. By identifying and selecting only the most relevant features, we are able to streamline our dataset and focus on the variables that have the highest impact on our analysis. This approach not only reduces computational complexity but also improves the interpretability of our results by eliminating unnecessary noise from the data. After applying the feature reduction technique, we proceed to implement a range of machine learning methods to perform our classification task. These include well-known algorithms such as Stacking, Extra Trees, Multi-Layer Perceptron, XGBoost, K-Nearest Neighbors, Logistic Regression, Naïve Bayes, Support Vector Machine, Random Forest, and Decision Tree. By employing a diverse set of algorithms, we are able to explore different modeling approaches and evaluate their effectiveness in accurately classifying the various types of assaults. In order to assess the performance of our classification models, we utilize a range of specialized evaluation metrics such as Root Mean Square Error (RMSE), Mean Absolute Error (MAE), R2-Score, Mean Squared Error (MSE), Precision, F1-Score, Recall, and Accuracy. These metrics provide us with a comprehensive understanding of how well our models are performing across different dimensions, including the accuracy of predictions, the level of precision in classifying different assault types, and the overall goodness-of-fit of our models. By considering multiple evaluation metrics, we are able to gain a more nuanced understanding of the strengths and weaknesses of each algorithm and make informed decisions about their suitability for our classification task. These metrics deliver a complete evaluation of the classifiers’ effectiveness in detecting community intrusions.

MSML: A Novel Multilevel Semi-Supervised Machine Learning Framework for Intrusion Detection System.

A Mixed Intrusion Detection System Utilizing K-means and Extreme Gradient Boosting

Multi-agent based hybrid Intrusion detection system

A Novel Intrusion Detection System Based on an Optimal Hybrid Kernel Extreme Learning Machine

A Novel Method for Feature Learning and Network Intrusion Classification

An Intrusion Detection Framework Based on Hybrid Multi-Level Data Mining

A Novel Framework Design of Network Intrusion Detection Based on Machine Learning Techniques

MSCA: an Unsupervised Anomaly Detection System for Network Security in Backbone Network.

Enhancing intrusion detection: a hybrid machine and deep learning approach

Intrusion Detection System with Machine Learning and Multiple Datasets

A Generalized and Robust Nonlinear Approach based on Machine Learning for Intrusion Detection

Performance evaluation of Machine learning algorithms for Intrusion Detection System

A Multi-Channel Contrastive Learning Network Based Intrusion Detection Method

Intrusion Detection Systems Using Support Vector Machines on the KDDCUP'99 and NSL-KDD Datasets: A Comprehensive Survey

LogMS: a multi-stage log anomaly detection method based on multi-source information fusion and probability label estimation

DEVELOPMENT OF A NEURAL NETWORK STRUCTURE FOR INTRUSION DETECTION ANALYSIS

Multi-Class Network Anomaly Detection Using Machine Learning Techniques

Intrusion Detection System Based on One-Class Support Vector Machine and Gaussian Mixture Model

A Framework for implementing an ML or DL model to improve Intrusion Detection Systems (IDS) in the NTMA context, with an example on the dataset (CSE-CIC-IDS2018)

Comparison of Machine Learning and Deep Learning Models for Network Intrusion Detection Systems

Optimized Ensemble Learning Models Based on Clustering and Hybrid Deep Learning for Wireless Intrusion Detection