Abstract:Deep learning-based object detection has become ubiquitous in the last decade due to its high accuracy in many real-world applications. With this growing trend, these models are interested in being attacked by adversaries, with most of the results being on classifiers, which do not match the context of practical object detection. In this work, we propose a novel method to fool object detectors, expose the vulnerability of state-of-the-art detectors, and promote later works to build more robust detectors to adversarial examples. Our method aims to generate adversarial images by perturbing object confidence scores during training, which is crucial in predicting confidence for each class in the testing phase. Herein, we provide a more intuitive technique to embed additive noises based on detected objects' masks and the training loss with distortion control over the original image by leveraging the gradient of iterative images. To verify the proposed method, we perform adversarial attacks against different object detectors, including the most recent state-of-the-art models like YOLOv8, Faster R-CNN, RetinaNet, and Swin Transformer. We also evaluate our technique on MS COCO 2017 and PASCAL VOC 2012 datasets and analyze the trade-off between success attack rate and image distortion. Our experiments show that the achievable success attack rate is up to $100$\% and up to $98$\% when performing white-box and black-box attacks, respectively. The source code and relevant documentation for this work are available at the following link: <a class="link-external link-https" href="https://github.com/anonymous20210106/attack_detector" rel="external noopener nofollow">this https URL</a>

ShiftAttack: Towards Attacking the Localization Ability of Object Detector

F&F Attack: Adversarial Attack Against Multiple Object Trackers by Inducing False Negatives and False Positives

Adversarial Attacks to Manipulate Target Localization of Object Detector

Distortion-Aware Adversarial Attacks on Bounding Boxes of Object Detectors

Towards Generic and Controllable Attacks Against Object Detection

Transferable Adversarial Attacks for Object Detection Using Object-Aware Significant Feature Distortion

To Make Yourself Invisible with Adversarial Semantic Contours

DPatch: An Adversarial Patch Attack on Object Detectors

Object-Aware Transfer-Based Black-Box Adversarial Attack on Object Detector.

Sparse Adversarial Attack to Object Detection

You Cannot Easily Catch Me: A Low-Detectable Adversarial Patch for Object Detectors

Object Hider: Adversarial Patch Attack Against Object Detectors

Out-of-Bounding-Box Triggers: A Stealthy Approach to Cheat Object Detectors

Steal Now and Attack Later: Evaluating Robustness of Object Detection against Black-box Adversarial Attacks

Transferable Adversarial Attack on Image Tampering Localization

Adversarial Attack for Object Detectors under Complex Conditions.

Pick-Object-Attack: Type-specific adversarial attack for object detection

Adversarial Detection: Attacking Object Detection in Real Time

A Transferable Adversarial Attack Against Object Detection Networks

DPAttack: Diffused Patch Attacks against Universal Object Detection

Making an Invisibility Cloak: Real World Adversarial Attacks on Object Detectors.