Abstract:Fuzzing is considered to be an essential approach to guarantee the reliability of deep neural networks (DNNs) based systems. The DNN fuzzing leverages various inputs prioritization methods to guide the testing process. The current research mainly focus on constructing testing metrics that symbolize the logical representation of the DNN to guide the generation of test cases, which neglects the potential performance brought by implementing heuristic algorithm. Moreover, the straightforward implementation of queue structure can not represent the metamorphic relationships between generated inputs in DNN fuzzing. Therefore, developing the appropriate heuristic algorithm-based inputs prioritization method is critical to improve the performance of DNN fuzzers. In this paper, we propose a Monte Carlo Tree Search (MCTS) based inputs prioritization method called E x 2 $E{x}<^>{2}$ (Exploration and Exploitation) that formulates DNN testing exploration as the sequential decision process. The technique introduces an innovative tree-structure design that schedules inputs from the statistical perspective. Different from traditional DNN testing, the batch pool is maintained in the form of nodes in MCTS. The links between nodes precisely represent the metamorphic relationship between input batches, which indicates the potential value for in-depth search. Furthermore, a novel simulation mechanism is implemented to adapt MCTS in DNN testing, which attain better coverage feedback. The effectiveness of our method is comprehensively investigated on six popular deep learning models from LeNet and VGG families. The comparison experiments are conducted between DeepHunter, TensorFuzz, and DeepSmartFuzzer to demonstrate efficacy on various testing metrics. The experimental results show that the E x 2 $E{x}<^>{2}$ significantly enhance the coverage gain of DNN fuzzing up to 30% against the best performance in comparison groups.

Ex 2 : Monte Carlo Tree Search‐based Test Inputs Prioritization for Fuzzing Deep Neural Networks

Evolutionary Mutation-based Fuzzing as Monte Carlo Tree Search

FA-Fuzz: A Novel Scheduling Scheme Using Firefly Algorithm for Mutation-Based Fuzzing

SpeedNeuzz: Speed Up Neural Program Approximation with Neighbor Edge Knowledge

Graph-Based Fuzz Testing for Deep Learning Inference Engine

Graph-based Fuzz Testing for Deep Learning Inference Engines

FDFuzz: Applying Feature Detection to Fuzz Deep Learning Systems

Data Augmentation by Fuzzing for Neural Test Generation

Not all bytes are equal: Neural byte sieve for fuzzing

Better Pay Attention Whilst Fuzzing.

DLFuzz: Differential Fuzzing Testing of Deep Learning Systems.

Prioritized Architecture Sampling with Monto-Carlo Tree Search

EnFuzz: from Ensemble Learning to Ensemble Fuzzing.

NESTFUZZ: Enhancing Fuzzing with Comprehensive Understanding of Input Processing Logic

HashC: Making DNNs' Coverage Testing Finer and Faster.

CAGFuzz: Coverage-Guided Adversarial Generative Fuzzing Testing of Deep Learning Systems

Coverage Guided Differential Adversarial Testing of Deep Learning Systems

Graphuzz: Data-driven Seed Scheduling for Coverage-guided Greybox Fuzzing

CAMFuzz: Explainable Fuzzing with Local Interpretation

Selecting Initial Seeds for Better JVM Fuzzing

MEUZZ: Smart Seed Scheduling for Hybrid Fuzzing