Abstract:Object detection plays a crucial role in scene understanding and has extensive practical applications. In the field of remote sensing object detection, both detection accuracy and robustness are of significant concern. Existing methods heavily rely on sophisticated adversarial training strategies that tend to improve robustness at the expense of accuracy. However, detection robustness is not always indicative of improved accuracy. Therefore, in this article, we research how to enhance robustness, while still preserving high accuracy, or even improve both simultaneously, with simple vanilla adversarial training or even in the absence thereof. In pursuit of a solution, we first conduct an exploratory investigation by shifting our attention from adversarial training, referred to as adversarial fine-tuning, to adversarial pretraining. Specifically, we propose a novel pretraining paradigm, namely, structured adversarial self-supervised (SASS) pretraining, to strengthen both clean accuracy and adversarial robustness for object detection in remote sensing images. At a high level, SASS pretraining aims to unify adversarial learning and self-supervised learning into pretraining and encode structured knowledge into pretrained representations for powerful transferability to downstream detection. Moreover, to fully explore the inherent robustness of vision Transformers and facilitate their pretraining efficiency, by leveraging the recent masked image modeling (MIM) as the pretext task, we further instantiate SASS pretraining into a concise end-to-end framework, named structured adversarial MIM (SA-MIM). SA-MIM consists of two pivotal components: structured adversarial attack and structured MIM (S-MIM). The former establishes structured adversaries for the context of adversarial pretraining, while the latter introduces a structured local-sampling global-masking strategy to adapt to hierarchical encoder architectures. Comprehensive experiments on three different datasets have demonstrated the significant superiority of the proposed pretraining paradigm over previous counterparts for remote sensing object detection. More importantly, regardless of with or without adversarial fine-tuning, it enables simultaneous improvements in detection accuracy and robustness as expected, promisingly alleviating the dependence on complicated adversarial fine-tuning.

A Robust Adversarial Defense Algorithm for Enhancing Salient Object Detection in Remote Sensing Image

Defense against Adversarial Cloud Attack on Remote Sensing Salient Object Detection

Robust and Refined Salient Object Detection Based on Diffusion Model

Learning Adversarially Robust Object Detector with Consistency Regularization in Remote Sensing Images

ROSA: Robust Salient Object Detection Against Adversarial Attacks

A Universal Defense Strategy Against Adversarial Attacks Based on Attention-Guided

Detection defense against adversarial attacks with saliency map

Noise-Sensitive Adversarial Learning for Weakly Supervised Salient Object Detection

An adversarial example attack method based on predicted bounding box adaptive deformation in optical remote sensing images

LeNo: Adversarial Robust Salient Object Detection Networks with Learnable Noise

DetectS Ec: Evaluating the Robustness of Object Detection Models to Adversarial Attacks

ORSI Salient Object Detection via Multiscale Joint Region and Boundary Model

Structured Adversarial Self-Supervised Learning for Robust Object Detection in Remote Sensing Images

CamoNet: A Target Camouflage Network for Remote Sensing Images Based on Adversarial Attack

Improving Adversarial Robustness of Detector Via Objectness Regularization

D etect S ec : Evaluating the robustness of object detection models to adversarial attacks

Improving Adversarial Robustness via Decoupled Visual Representation Masking

D3R-Net: Denoising Diffusion-Based Defense Restore Network for Adversarial Defense in Remote Sensing Scene Classification

SAD: Saliency-based Defenses Against Adversarial Examples

Bi-Branch Multiscale Feature Joint Network for ORSI Salient Object Detection in Adverse Weather Conditions

A Region-Adaptive Local Perturbation-Based Method for Generating Adversarial Examples in Synthetic Aperture Radar Object Detection