Abstract:Computer networks rely on Intrusion Detection Systems (IDSs) and Intrusion Prevention Systems (IPSs) to ensure the security, reliability, and availability of an organization. In recent years, various approaches were developed and implemented to create effective IDSs and IPSs. This paper specifically focuses on IDSs that utilize Machine Learning (ML) techniques for improved accuracy. ML-based IDSs have verified to be successful in discovering network attacks. However, their performance tends to decline when dealing with high-dimensional data spaces. It is essential to develop a suitable feature extraction strategy that could identify and remove irrelevant features that do not significantly classification process to address this issue. Additionally, many ML-based IDSs exhibit high false positive rates and poor detection accuracy when trained on unbalanced datasets. In this study, we analyze the UNSW-NB15 IDS, which will serve as the training and testing data for our models. In order to reduce the feature space and improve the efficiency of our analysis, we leverage a filter-based feature reduction method utilizing the Pearson correlation coefficient algorithm. By identifying and selecting only the most relevant features, we are able to streamline our dataset and focus on the variables that have the highest impact on our analysis. This approach not only reduces computational complexity but also improves the interpretability of our results by eliminating unnecessary noise from the data. After applying the feature reduction technique, we proceed to implement a range of machine learning methods to perform our classification task. These include well-known algorithms such as Stacking, Extra Trees, Multi-Layer Perceptron, XGBoost, K-Nearest Neighbors, Logistic Regression, Naïve Bayes, Support Vector Machine, Random Forest, and Decision Tree. By employing a diverse set of algorithms, we are able to explore different modeling approaches and evaluate their effectiveness in accurately classifying the various types of assaults. In order to assess the performance of our classification models, we utilize a range of specialized evaluation metrics such as Root Mean Square Error (RMSE), Mean Absolute Error (MAE), R2-Score, Mean Squared Error (MSE), Precision, F1-Score, Recall, and Accuracy. These metrics provide us with a comprehensive understanding of how well our models are performing across different dimensions, including the accuracy of predictions, the level of precision in classifying different assault types, and the overall goodness-of-fit of our models. By considering multiple evaluation metrics, we are able to gain a more nuanced understanding of the strengths and weaknesses of each algorithm and make informed decisions about their suitability for our classification task. These metrics deliver a complete evaluation of the classifiers’ effectiveness in detecting community intrusions.

Multiple classifier system with feature grouping for intrusion detection: mutual information approach

A Mixed Intrusion Detection System Utilizing K-means and Extreme Gradient Boosting

Multi-agent based hybrid Intrusion detection system

An Intrusion Detection Feature Selection Method Based on Improved Mutual Information

Multi-agent Intrusion Detection System Using Feature Selection Approach

Comparison of Different Fusion Approaches for Network Intrusion Detection Using Ensemble of RBFNN

The Use of Ensemble Models for Multiple Class and Binary Class Classification for Improving Intrusion Detection Systems

Network Intrusion Detection by Multi-group Mathematical Programming based Classifier

Modified Mutual Information-based Feature Selection for Intrusion Detection Systems in Decision Tree Learning.

An Efficient Network Intrusion Detection System Based on Feature Selection and Ensemble Classifier.

Empirical Study on Fusion Methods Using Ensemble of RBFNN for Network Intrusion Detection

A Multiple-Criteria Quadratic Programming Approach to Network Intrusion Detection.

Feature Grouping for Intrusion Detection System Based on Hierarchical Clustering.

2-layer classification model with correlated common feature selection for intrusion detection system in networks

An empirical evaluation for the intrusion detection features based on machine learning and feature selection methods

An adaptive network intrusion detection method based on PCA and support vector machines

Network intrusion detection through Adaptive Sub-Eigenspace Modeling in multiagent systems

Multi-Class Network Anomaly Detection Using Machine Learning Techniques

M-MultiSVM: An efficient feature selection assisted network intrusion detection system using machine learning

Effective Metaheuristic Based Classifiers for Multiclass Intrusion Detection

Building an Efficient Intrusion Detection System Based on Feature Selection and Ensemble Classifier