MODGF: Multi-Objective Optimization Approach for Directed Greybox Fuzzing

Xueying Zuo,Yubo Song,Run Mao,Zhongyuan Qin,Xin Sun
DOI: https://doi.org/10.1109/hpcc-dss-smartcity-dependsys60770.2023.00024
2023-01-01
Abstract:Directed Greybox Fuzzing employs code analysis to predict critical paths or potential vulnerabilities. Multi-objective optimization is a challenge to Directed Greybox Fuzzing. Current approaches employ evolutionary algorithms which may trap in local optima during mutation operation procedure. In this paper, we propose MODGF, a Directed Greybox Fuzzing method based on the elitist multi-objective evolutionary algorithm. The key insight of our approach is to get a more diverse distribution along the Pareto front during evolutionary iterations, which speed the convergence of the test cases. In MODGF, we use function distance, basic block distance, and seed distance as objective functions, and calculate distance metrics of the nearest neighbor solutions to infer the distribution density of solutions. We further introduce convergence measure and diversity measure as fitness values to ensure that the generated test cases are more uniformly distributed with more vulnerability types. In comparison to AFL and AFL-GO, the experiment reveals that MODGF exhibits significant performance enhancements in terms of convergence time, target function coverage, and vulnerability triggering efficiency.
What problem does this paper attempt to address?