Abstract:Machine learning (ML), especially deep learning (DL) techniques have been increasingly used in anomaly-based network intrusion detection systems (NIDS). However, ML/DL has shown to be extremely vulnerable to adversarial attacks, especially in such security-sensitive systems. Many adversarial attacks have been proposed to evaluate the robustness of ML-based NIDSs. Unfortunately, existing attacks mostly focused on feature-space and/or white-box attacks, which make impractical assumptions in real-world scenarios, leaving the study on practical gray/black-box attacks largely unexplored. To bridge this gap, we conduct the first systematic study of the gray/black-box traffic-space adversarial attacks to evaluate the robustness of ML-based NIDSs. Our work outperforms previous ones in the following aspects: (i) practical —the proposed attack can automatically mutate original traffic with extremely limited knowledge and affordable overhead while preserving its functionality; (ii) generic —the proposed attack is effective for evaluating the robustness of various NIDSs using diverse ML/DL models and non-payload-based features; (iii) explainable —we propose an explanation method for the fragile robustness of ML-based NIDSs. Based on this, we also propose a defense scheme against adversarial attacks to improve system robustness. We extensively evaluate the robustness of various NIDSs using diverse feature sets and ML/DL models. Experimental results show our attack is effective (e.g., >97% evasion rate in half cases for Kitsune, a state-of-the-art NIDS) with affordable execution cost and the proposed defense method can effectively mitigate such attacks (evasion rate is reduced by >50% in most cases).

Robustness Quantification Method for Network Intrusion Detection Models

There is Limited Correlation Between Coverage and Robustness for Deep Neural Networks

An Empirical Study on Correlation between Coverage and Robustness for Deep Neural Networks

Predicted Robustness as QoS for Deep Neural Network Models

Interpreting and Evaluating Neural Network Robustness

ROBY: Evaluating the adversarial robustness of a deep model by its decision boundaries

Evaluating and Improving Adversarial Robustness of Machine Learning-Based Network Intrusion Detectors

Fast Robustness Prediction for Deep Neural Network

Improving Model Robustness Against Adversarial Examples with Redundant Fully Connected Layer.

Towards Precise Observations of Neural Model Robustness in Classification

Robust Adversarial Attacks on Imperfect Deep Neural Networks in Fault Classification

Adversarial Robustness of Deep Neural Networks: A Survey from a Formal Verification Perspective

Robust Network Intrusion Detection Scheme Using Long-Short Term Memory Based Convolutional Neural Networks

Towards Certifying the Asymmetric Robustness for Neural Networks: Quantification and Applications

Strengthening Network Security: Deep Learning Models for Intrusion Detection with Optimized Feature Subset and Effective Imbalance Handling

SoK: Certified Robustness for Deep Neural Networks

A Survey of Neural Network Robustness Assessment in Image Recognition

An Integrated Approach to Produce Robust Models with High Efficiency

D etect S ec : Evaluating the robustness of object detection models to adversarial attacks

DetectS Ec: Evaluating the Robustness of Object Detection Models to Adversarial Attacks

Towards A Critical Evaluation of Robustness for Deep Learning Backdoor Countermeasures