Abstract:In the software engineering (SE) community, deep learning (DL) has recently been applied to many source code processing tasks, achieving state-of-the-art results. Due to the poor interpretability of DL models, their security vulnerabilities require scrutiny. Recently, researchers have identified an emergent security threat to DL models, namely poison attacks . The attackers aim to inject insidious backdoors into DL models by poisoning the training data with poison samples. The backdoors mean that poisoned models work normally with clean inputs but produce targeted erroneous results with inputs embedded with specific triggers. By using triggers to activate backdoors, attackers can manipulate poisoned models in security-related scenarios ( e.g., defect detection) and lead to severe consequences. To verify the vulnerability of deep source code processing models to poison attacks, we present a poison attack approach for source code named CodePoisoner as a strong imaginary enemy. CodePoisoner can produce compilable and functionality-preserving poison samples and effectively attack deep source code processing models by poisoning the training data with poison samples. To defend against poison attacks, we further propose an effective poison detection approach named CodeDetector . CodeDetector can automatically identify poison samples in the training data. We apply CodePoisoner and CodeDetector to six deep source code processing models, including defect detection, clone detection, and code repair models. The results show that 1 CodePoisoner conducts successful poison attacks with a high attack success rate (avg: 98.3%, max: 100%). It validates that existing deep source code processing models have a strong vulnerability to poison attacks. 2 CodeDetector effectively defends against multiple poison attack approaches by detecting (max: 100%) poison samples in the training data. We hope this work can help SE researchers and practitioners notice poison attacks and inspire the design of more advanced defense techniques.

Poisoning Machine Learning Based Wireless Idss Via Stealing Learning Model

BEBP: an Poisoning Method Against Machine Learning Based IDSs

Chronic Poisoning Against Machine Learning Based IDSs Using Edge Pattern Detection

Poisoning Attacks and Data Sanitization Mitigations for Machine Learning Models in Network Intrusion Detection Systems

Automatic Evasion of Machine Learning-Based Network Intrusion Detection Systems

Poisoning attacks and countermeasures in intelligent networks: Status quo and prospects

FMSA: a Meta-Learning Framework-Based Fast Model Stealing Attack Technique Against Intelligent Network Intrusion Detection Systems

Invisible Poisoning: Highly Stealthy Targeted Poisoning Attack

A Flexible Poisoning Attack Against Machine Learning.

SecFedNIDS: Robust Defense for Poisoning Attack Against Federated Learning-Based Network Intrusion Detection System

Efficient Poisoning Attacks and Defenses for Unlabeled Data in DDoS Prediction of Intelligent Transportation Systems

Adversarial Attacks Against Network Intrusion Detection in IoT Systems

A Manifold Consistency Interpolation Method of Poisoning Attacks Against Semi-Supervised Model.

Generating Adversarial Examples Against Machine Learning-Based Intrusion Detector in Industrial Control Systems

Poisoning Attacks on Machine Learning Models in Cyber Systems and Mitigation Strategies

PPFL-IDS: Privacy-Preserving Federated Learning Based IDS Against Poisoning Attacks

Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning

Analysis on Data Poisoning Attack Detection Using Machine Learning Techniques and Artificial Intelligence

Poison Attack and Poison Detection on Deep Source Code Processing Models

Poison Attack and Defense on Deep Source Code Processing Models

Adversarial machine learning in Network Intrusion Detection Systems