Abstract:Given the pervasive use of deep learning models across various domains, ensuring model security has emerged as a critical concern. This paper examines backdoor attacks, a form of security threat that compromises model output by poisoning the training data. Our investigation specifically addresses backdoor attacks on object detection models, vital for security-sensitive applications like autonomous driving and smart city systems. Consequently, such attacks on object detection models could pose significant risks to human life and property. Consequently, backdoor attacks on object detection could pose serious threats to human life and property. To elucidate this security risk, we propose and experimentally evaluate five backdoor attack methods for object detection models. The key findings are: (1) Unnecessary Object Generation : a globally embedded trigger creating false objects in the target class; (2) Partial Misclassification : a trigger causing specific class misclassification; (3) Global Misclassification : a trigger reclassifying all objects into the target class; (4) Specific Object Vanishing : a trigger causing non-detection of certain objects; (5) Object Position Shifting : a trigger causing bounding box shifts for a specific class. To assess attack effectiveness, we introduced the Attack Success Rate (ASR), which can surpass 1 in object detection tasks, thus providing a more accurate reflection of the attack impact. Experimental outcomes indicate that the ASR values of these varied backdoor attacks frequently approach or surpass 1, demonstrating our method's capacity to impact multiple objects simultaneously. Additionally, to augment trigger stealth, we introduce Backdoor Attack with Wavelet Embedding (BAWE), which discreetly embeds triggers as image watermarks in training data. This embedding method yields more natural triggers with enhanced stealth. Highly stealthy triggers are less detectable, significantly increasing the likelihood of attack success and efficacy. We have developed a Transformer-based network architecture , diverging from traditional neural network frameworks. Our experiments across various object detection datasets highlight the susceptibility of these models and the high success rate of our approaches. This vulnerability poses significant risks to digital twin systems utilizing object detection technology. Our methodology not only enhances trigger stealth but also suits dense predictive tasks and circumvents current neural network backdoor attack detection methods. The experimental findings expose key challenges in the security of object detection models, particularly when integrated with digital twins, offering new avenues for backdoor attack research and foundational insights for devising defense strategies against these attacks.

Exploring the Vulnerability of Self-supervised Monocular Depth Estimation Models

B3: Backdoor Attacks Against Black-box Machine Learning Models

Adversarial Attacks on Monocular Depth Estimation

Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attacks

Physical Attack on Monocular Depth Estimation with Optimal Adversarial Patches

Optical Lens Attack on Deep Learning Based Monocular Depth Estimation

Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attacks

Monocular Depth Estimators: Vulnerabilities and Attacks

Optical Lens Attack on Monocular Depth Estimation for Autonomous Driving

Untargeted Backdoor Attack Against Object Detection

Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Driving

Backdoor Attacks with Wavelet Embedding: Revealing and enhancing the insights of vulnerabilities in visual object detection models on transformers within digital twin systems

BadDet: Backdoor Attacks on Object Detection

Adversarial Manhole: Challenging Monocular Depth Estimation and Semantic Segmentation Models with Patch Attack

SAAM: Stealthy Adversarial Attack on Monocular Depth Estimation

Towards Imperceptible Backdoor Attack in Self-supervised Learning

AdvDoor: Adversarial Backdoor Attack of Deep Learning System

Detector Collapse: Physical-World Backdooring Object Detection to Catastrophic Overload or Blindness in Autonomous Driving

Physical Adversarial Attack on Monocular Depth Estimation via Shape-Varying Patches

Backdoor Attacks Against Deep Learning Systems in the Physical World