Abstract:In the software engineering community, deep learning (DL) has recently been applied to many source code processing tasks. Due to the poor interpretability of DL models, their security vulnerabilities require scrutiny. Recently, researchers have identified an emergent security threat, namely poison attack. The attackers aim to inject insidious backdoors into models by poisoning the training data with poison samples. Poisoned models work normally with clean inputs but produce targeted erroneous results with poisoned inputs embedded with triggers. By activating backdoors, attackers can manipulate the poisoned models in security-related scenarios. To verify the vulnerability of existing deep source code processing models to the poison attack, we present a poison attack framework for source code named CodePoisoner as a strong imaginary enemy. CodePoisoner can produce compilable even human-imperceptible poison samples and attack models by poisoning the training data with poison samples. To defend against the poison attack, we further propose an effective defense approach named CodeDetector to detect poison samples in the training data. CodeDetector can be applied to many model architectures and effectively defend against multiple poison attack approaches. We apply our CodePoisoner and CodeDetector to three tasks, including defect detection, clone detection, and code repair. The results show that (1) CodePoisoner achieves a high attack success rate (max: 100%) in misleading models to targeted erroneous behaviors. It validates that existing deep source code processing models have a strong vulnerability to the poison attack. (2) CodeDetector effectively defends against multiple poison attack approaches by detecting (max: 100%) poison samples in the training data. We hope this work can help practitioners notice the poison attack and inspire the design of more advanced defense techniques.

Accelerating Poisoning Attack Through Momentum And Adam Algorithms

Data Poisoning Attacks in Internet-of-Vehicle Networks: Taxonomy, State-of-The-Art, and Future Directions.

With Great Dispersion Comes Greater Resilience: Efficient Poisoning Attacks and Defenses for Linear Regression Models

Poisoning Attacks against Support Vector Machines

Accumulative Poisoning Attacks on Real-time Data

Transferable Availability Poisoning Attacks

Towards A Proactive ML Approach for Detecting Backdoor Poison Samples

Model-Targeted Poisoning Attacks with Provable Convergence

Invisible Poisoning: Highly Stealthy Targeted Poisoning Attack

Demystifying Poisoning Backdoor Attacks from a Statistical Perspective

De-Pois: An Attack-Agnostic Defense against Data Poisoning Attacks

Threats to Training: A Survey of Poisoning Attacks and Defenses on Machine Learning Systems

Poisoning Attacks with Generative Adversarial Nets

Exploring Model Dynamics for Accumulative Poisoning Discovery

Indiscriminate Data Poisoning Attacks on Neural Networks

MetaPoison: Practical General-purpose Clean-label Data Poisoning

Boosting Backdoor Attack with A Learnable Poisoning Sample Selection Strategy

Poison Attack and Defense on Deep Source Code Processing Models

Amplifying Membership Exposure via Data Poisoning

Assessing Vulnerabilities of Adversarial Learning Algorithm through Poisoning Attacks

Stronger Data Poisoning Attacks Break Data Sanitization Defenses