Abstract:Alert fatigue problems can have serious consequences for the enterprise security. When analysts become overwhelmed by the sheer number of alerts, high-risk alerts may go unnoticed or receive delayed responses, exposing the organization to potential cyber threats or data breaches. While current research on alert triage primarily concentrates on reducing false positives, analysts still face a shortage of resources to investigate all true alerts. The key to resolving this issue lies in the prioritization of alerts based on their potential severity, allowing analysts to allocate their efforts effectively. This paper introduces AlertPro, an alert prioritization framework that facilitates the alert triage and validation stage of typical SOC workflow. The AlertPro framework extracts context features from alert sequences and history features from alerts previously investigated by analysts, besides basic features from raw alert data. By presenting analysts with only the top-ranked potentially high-risk alerts in each query and continually updating these rankings based on feedback, AlertPro significantly streamlines the alert investigation process. To evaluate AlertPro, we conducted experiments on five datasets that are chosen or prepared specifically because they all include multi-step attacks. The results reveal that AlertPro is able to discover a previously undisclosed attack concealed within the public dataset iscx, illustrating its potential in enhancing security posture. We also evaluate the feature importance in anomaly detection and conclude that employing context features yields better performance over basic features. The paper also explores the effectiveness of incorporating history features in active learning, achieving an average improvement of 30% in attack discovery rates. The processing time of AlertPro for re-ranking and selecting high-risk alerts is within 0.5 seconds, indicating that AlertPro can effectively work in real-time scenarios. AlertPro is limited to only using partial feedback and can be improved by incorporating richer feedback from experts. Overall, AlertPro mitigates alert fatigue, enabling security analysts to concentrate their efforts on high-priority threats.

Alert reduction for network intrusion detection

Use of host's software information to mitigate false positive in signature-based NIDS

A Novel Data Mining-Based Method for Alert Reduction and Analysis.

Discovering Attack Scenarios Via Intrusion Alert Correlation Using Graph Convolutional Networks

Using Outlier Detection to Reduce False Positives in Intrusion Detection

DualAC2NN: Revisiting and Alleviating Alert Fatigue from the Detection Perspective

Data Reduction in Intrusion Alert Correlation

Effective Noise Reduction in NDR Systems: A Simple Yet Powerful Apriori-Based Approach

An Intrusion Detection Model Based on Feature Reduction and Convolutional Neural Networks

An Automated Alert Cross-Verification System with Graph Neural Networks for IDS Events

A computationally efficient dimensionality reduction and attack classification approach for network intrusion detection

Discovering Anomaly on the Basis of Flow Estimation of Alert Feature Distribution

MAAC: Novel Alert Correlation Method To Detect Multi-step Attack

Combating alert fatigue with AlertPro: Context-aware alert prioritization using reinforcement learning for multi-step attack detection

A Novel Framework Design of Network Intrusion Detection Based on Machine Learning Techniques

An alert correlating algorithm based on multi-step attack path graphs:MSACA

Introducing a New Alert Data Set for Multi-Step Attack Analysis

NoDoze - Combatting Threat Alert Fatigue with Automated Provenance Triage.

Intrusion Alerts Correlation Based Assessment of Network Security

The Research of Alert Correlation Based on Attack Intetion

A multiscale approach for network intrusion detection based on variance–covariance subspace distance and EQL v2