Abstract:Computer networks rely on Intrusion Detection Systems (IDSs) and Intrusion Prevention Systems (IPSs) to ensure the security, reliability, and availability of an organization. In recent years, various approaches were developed and implemented to create effective IDSs and IPSs. This paper specifically focuses on IDSs that utilize Machine Learning (ML) techniques for improved accuracy. ML-based IDSs have verified to be successful in discovering network attacks. However, their performance tends to decline when dealing with high-dimensional data spaces. It is essential to develop a suitable feature extraction strategy that could identify and remove irrelevant features that do not significantly classification process to address this issue. Additionally, many ML-based IDSs exhibit high false positive rates and poor detection accuracy when trained on unbalanced datasets. In this study, we analyze the UNSW-NB15 IDS, which will serve as the training and testing data for our models. In order to reduce the feature space and improve the efficiency of our analysis, we leverage a filter-based feature reduction method utilizing the Pearson correlation coefficient algorithm. By identifying and selecting only the most relevant features, we are able to streamline our dataset and focus on the variables that have the highest impact on our analysis. This approach not only reduces computational complexity but also improves the interpretability of our results by eliminating unnecessary noise from the data. After applying the feature reduction technique, we proceed to implement a range of machine learning methods to perform our classification task. These include well-known algorithms such as Stacking, Extra Trees, Multi-Layer Perceptron, XGBoost, K-Nearest Neighbors, Logistic Regression, Naïve Bayes, Support Vector Machine, Random Forest, and Decision Tree. By employing a diverse set of algorithms, we are able to explore different modeling approaches and evaluate their effectiveness in accurately classifying the various types of assaults. In order to assess the performance of our classification models, we utilize a range of specialized evaluation metrics such as Root Mean Square Error (RMSE), Mean Absolute Error (MAE), R2-Score, Mean Squared Error (MSE), Precision, F1-Score, Recall, and Accuracy. These metrics provide us with a comprehensive understanding of how well our models are performing across different dimensions, including the accuracy of predictions, the level of precision in classifying different assault types, and the overall goodness-of-fit of our models. By considering multiple evaluation metrics, we are able to gain a more nuanced understanding of the strengths and weaknesses of each algorithm and make informed decisions about their suitability for our classification task. These metrics deliver a complete evaluation of the classifiers’ effectiveness in detecting community intrusions.

Identifying the most accurate machine learning classification technique to detect network threats

Classification model for accuracy and intrusion detection using machine learning approach

Cyber Intrusion Detection Using Machine Learning Classification Techniques

Machine Learning Methods for Network Intrusion Detection

A Novel Method for Feature Learning and Network Intrusion Classification

Comparative Analysis of Intrusion Detection System Using Machine Learning and Deep Learning Algorithms

Machine learning approaches to network intrusion detection for contemporary internet traffic

Network intrusion detection using oversampling technique and machine learning algorithms

An Efficient Network Intrusion Detection and Classification System

Designing a Network Intrusion Detection System Based on Machine Learning for Software Defined Networks

An empirical evaluation for the intrusion detection features based on machine learning and feature selection methods

Multi-Class Network Anomaly Detection Using Machine Learning Techniques

Optimized IoT Intrusion Detection using Machine Learning Technique

Attack based DoS attack detection using multiple classifier

Performance evaluation of Machine learning algorithms for Intrusion Detection System

A hybrid ensemble machine learning model for detecting APT attacks based on network behavior anomaly detection

Proactive Threat Hunting in Critical Infrastructure Protection through Hybrid Machine Learning Algorithm Application

Machine learning to improve the performance of anomaly-based network intrusion detection in big data

Sdn Intrusion Detection Using Machine Learning Method

Exploiting SNMP-MIB Data to Detect Network Anomalies using Machine Learning Techniques

Artificial Intelligence outflanks all other machine learning classifiers in Network Intrusion Detection System on the realistic cyber dataset CSE-CIC-IDS2018 using cloud computing