Abstract:Deep Learning systems (DL) based on Deep Neural Networks (DNNs) are more and more used in various aspects of our life, including unmanned vehicles, speech processing, and robotics. However, due to the limited dataset and the dependence on manual labeling data, DNNs often fail to detect their erroneous behaviors, which may lead to serious problems. Several approaches have been proposed to enhance the input examples for testing DL systems. However, they have the following limitations. First, they design and generate adversarial examples from the perspective of model, which may cause low generalization ability when they are applied to other models. Second, they only use surface feature constraints to judge the difference between the adversarial example generated and the original example. The deep feature constraints, which contain high-level semantic information, such as image object category and scene semantics are completely neglected. To address these two problems, in this paper, we propose CAGFuzz, a Coverage-guided Adversarial Generative Fuzzing testing approach, which generates adversarial examples for a targeted DNN to discover its potential defects. First, we train an adversarial case generator (AEG) from the perspective of general data set. Second, we extract the depth features of the original and adversarial examples, and constrain the adversarial examples by cosine similarity to ensure that the semantic information of adversarial examples remains unchanged. Finally, we retrain effective adversarial examples to improve neuron testing coverage rate. Based on several popular data sets, we design a set of dedicated experiments to evaluate CAGFuzz. The experimental results show that CAGFuzz can improve the neuron coverage rate, detect hidden errors, and also improve the accuracy of the target DNN.

Research on Fuzzy Test Technology Based on Generative Adversarial Networks

Research on Test Cases Screening Method Based on Generative Adversarial Networks

A Novel Method for Fuzzing Test Cases Generating Based on Genetic Algorithm

Web Application Vulnerability Fuzzing Based on Improved Genetic Algorithm

A Novel Seed Generation Approach for Vulnerability Mining Based on Generative Adversarial Networks and Attention Mechanisms

Test Case Generation for Vulnerability Detection Using Genetic Algorithm

VecSeeds: Generate Fuzzing Testcases from Latent Vectors Based on VAE-GAN.

FuzzGAN: A Generation-Based Fuzzing Framework for Testing Deep Neural Networks

Vulnerability Mining Method Based On Genetic Algorithm And Model Constraint

An Intelligent Fuzzing Data Generation Method Based on Deep Adversarial Learning.

WGAN-AFL: Seed Generation Augmented Fuzzer with Wasserstein-GAN

CVDF DYNAMIC-A Dynamic Fuzzy Testing Sample Generation Framework Based on BI-LSTM and Genetic Algorithm

Vulnerability Analysis for X86 Executables Using Genetic Algorithm and Fuzzing

Combinatorial Test Suites Generation Method Based on Fuzzy Genetic Algorithm.

RapidFuzz: Accelerating fuzzing via Generative Adversarial Networks

Vulnerability Detection Through an Adversarial Fuzzing Algorithm

Generative Adversarial Network (GAN)-Based Autonomous Penetration Testing for Web Applications

CAGFuzz: Coverage-Guided Adversarial Generative Fuzzing Testing of Deep Learning Systems

Intelligent Fuzzy Attack Vector Generation Framework Based on Deep Adversarial Learning

GAXSS: Effective Payload Generation Method to Detect XSS Vulnerabilities Based on Genetic Algorithm

AutoGenD: Fuzz Driver Generation for Binary Libraries Without Header Files and Symbol Information