Abstract:Threat hunting is a proactive security defense line exercised to uncover attacks that could circumvent conventional detection mechanisms. It is based on an iterative approach to generate, inspect, and revise attack hypotheses. The quality of these hypotheses is essential to prove/refute the existence of an attack. Today, attack hypotheses are often generated manually by security analysts. The generation process requires elusive expertise, is costly, and is prone to produce a large number of irrelevant hypotheses without considering the attack variants. In this paper, we address the aforementioned challenges by designing AUTOMA, a solution that automates the generation of relevant hypotheses and their variants using knowledge discovery. AUTOMA incorporates the system telemetry in combination with a knowledge base of existing attacks, techniques, and their relationships to mine the most relevant hypotheses. In order to increase the relevance of the generated hypotheses, AUTOMA examines these hypotheses by applying matching-based similarity, success, likelihood, and criticality evaluations. These evaluations are based on the past occurrences of the techniques part of a hypothesis in the system telemetry and the knowledge base. Additionally, AUTOMA uses sequence success, sequence alignment, and hierarchical similarity approach for generating potential attack variants of a hypothesis taking into account the dynamism and stealthiness of attackers in coming up with alternative attack steps. We extensively evaluate the effectiveness and efficiency of AUTOMA using a real dataset for 284 attack campaigns distributed over 57 advanced persistent threats. The obtained results show that AUTOMA is able to generate the relevant hypothesis (top 3), with a large reduction rate (up to 99%), and fast execution time (up to 8 minutes for proposing the relevant hypothesis and 10 seconds for variants generation).

Threat Trekker: An Approach to Cyber Threat Hunting

A System for Efficiently Hunting for Cyber Threats in Computer Systems Using Threat Intelligence

Enabling Efficient Cyber Threat Hunting with Cyber Threat Intelligence

A Threat Hunting Framework for Industrial Control Systems

Data-Driven Threat Hunting Using Sysmon

Evidential Cyber Threat Hunting

An Efficient Approach of Threat Hunting Using Memory Forensics

Fuzzy to Clear: Elucidating the Threat Hunter Cognitive Process and Cognitive Support Needs

Intelligent Threat Detection—AI-Driven Analysis of Honeypot Data to Counter Cyber Threats

Proactive Threat Hunting in Critical Infrastructure Protection through Hybrid Machine Learning Algorithm Application

Explainable artificial intelligence envisioned security mechanism for cyber threat hunting

AnyThreat: An Opportunistic Knowledge Discovery Approach to Insider Threat Detection

AUTOMA: Automated Generation of Attack Hypotheses and Their Variants for Threat Hunting Using Knowledge Discovery

Hypothesis Generation Model for Cyber Threat Hunting

Harnessing TI Feeds for Exploitation Detection

An Interview Study on Third-Party Cyber Threat Hunting Processes in the U.S. Department of Homeland Security

A holistic and proactive approach to forecasting cyber threats

LogKernel A Threat Hunting Approach Based on Behaviour Provenance Graph and Graph Kernel Clustering

Towards a Near-real-time Protocol Tunneling Detector based on Machine Learning Techniques

Detection of advanced persistent threats using hashing and graph-based learning on streaming data

Discovering Emerging Threats in the Hacker Community: A Nonparametric Emerging Topic Detection Framework