Abstract:Recent research in both academia and industry has validated the effectiveness of provenance graph-based detection for advanced cyber attack detection and investigation. However, analyzing large-scale provenance graphs often results in substantial overhead. To improve performance, existing detection systems implement various optimization strategies. Yet, as several recent studies suggest, these strategies could lose necessary context information and be vulnerable to evasions. Designing a detection system that is efficient and robust against adversarial attacks is an open problem. We introduce Marlin, which approaches cyber attack detection through real-time provenance graph <a class="link-external link-http" href="http://alignment.By" rel="external noopener nofollow">this http URL</a> leveraging query graphs embedded with attack knowledge, Marlin can efficiently identify entities and events within provenance graphs, embedding targeted analysis and significantly narrowing the search space. Moreover, we incorporate our graph alignment algorithm into a tag propagation-based schema to eliminate the need for storing and reprocessing raw logs. This design significantly reduces in-memory storage requirements and minimizes data processing overhead. As a result, it enables real-time graph alignment while preserving essential context information, thereby enhancing the robustness of cyber attack detection. Moreover, Marlin allows analysts to customize attack query graphs flexibly to detect extended attacks and provide interpretable detection results. We conduct experimental evaluations on two large-scale public datasets containing 257.42 GB of logs and 12 query graphs of varying sizes, covering multiple attack techniques and scenarios. The results show that Marlin can process 137K events per second while accurately identifying 120 subgraphs with 31 confirmed attacks, along with only 1 false positive, demonstrating its efficiency and accuracy in handling massive data.

Attack Provenance Tracing in Cyberspace: Solutions, Challenges and Future Directions

Combating Advanced Persistent Threats: Challenges and Solutions

Threat detection and investigation with system-level provenance graphs: A survey

Provenance-based Intrusion Detection: Opportunities and Challenges

threaTrace: Detecting and Tracing Host-based Threats in Node Level Through Provenance Graph Learning

TAGS: Real-time Intrusion Detection with Tag-Propagation-based Provenance Graph Alignment on Streaming Events

NODLINK: An Online System for Fine-Grained APT Attack Detection and Investigation

Marlin: Knowledge-Driven Analysis of Provenance Graphs for Efficient and Robust Detection of Cyber Attacks

Advanced Persistent Threat intelligent profiling technique: A survey

Sequence Feature Extraction-Based APT Attack Detection Method with Provenance Graphs

TBDetector:Transformer-Based Detector for Advanced Persistent Threats with Provenance Graph

DISTDET: A Cost-Effective Distributed Cyber Threat Detection System

Prov2vec: Learning Provenance Graph Representation for Unsupervised APT Detection

A PT-based Approach to Construct Efficient Provenance Graph for Threat Alert Investigation

LTRDetector: Exploring Long-Term Relationship for Advanced Persistent Threats Detection

You Are What You Do: Hunting Stealthy Malware Via Data Provenance Analysis

SPARSE: Semantic Tracking and Path Analysis for Attack Investigation in Real-time

TREC: APT Tactic / Technique Recognition via Few-Shot Provenance Subgraph Learning

Slot: Provenance-Driven APT Detection through Graph Reinforcement Learning

Zebra: Deeply Integrating System-Level Provenance Search and Tracking for Efficient Attack Investigation

Retrofitting Applications with Provenance-Based Security Monitoring