Abstract:Object detection plays a crucial role in scene understanding and has extensive practical applications. In the field of remote sensing object detection, both detection accuracy and robustness are of significant concern. Existing methods heavily rely on sophisticated adversarial training strategies that tend to improve robustness at the expense of accuracy. However, detection robustness is not always indicative of improved accuracy. Therefore, in this article, we research how to enhance robustness, while still preserving high accuracy, or even improve both simultaneously, with simple vanilla adversarial training or even in the absence thereof. In pursuit of a solution, we first conduct an exploratory investigation by shifting our attention from adversarial training, referred to as adversarial fine-tuning, to adversarial pretraining. Specifically, we propose a novel pretraining paradigm, namely, structured adversarial self-supervised (SASS) pretraining, to strengthen both clean accuracy and adversarial robustness for object detection in remote sensing images. At a high level, SASS pretraining aims to unify adversarial learning and self-supervised learning into pretraining and encode structured knowledge into pretrained representations for powerful transferability to downstream detection. Moreover, to fully explore the inherent robustness of vision Transformers and facilitate their pretraining efficiency, by leveraging the recent masked image modeling (MIM) as the pretext task, we further instantiate SASS pretraining into a concise end-to-end framework, named structured adversarial MIM (SA-MIM). SA-MIM consists of two pivotal components: structured adversarial attack and structured MIM (S-MIM). The former establishes structured adversaries for the context of adversarial pretraining, while the latter introduces a structured local-sampling global-masking strategy to adapt to hierarchical encoder architectures. Comprehensive experiments on three different datasets have demonstrated the significant superiority of the proposed pretraining paradigm over previous counterparts for remote sensing object detection. More importantly, regardless of with or without adversarial fine-tuning, it enables simultaneous improvements in detection accuracy and robustness as expected, promisingly alleviating the dependence on complicated adversarial fine-tuning.

Learning Adversarially Robust Object Detector with Consistency Regularization in Remote Sensing Images

Feature Decoupling Based Adversarial Examples Detection Method for Remote Sensing Scene Classification

Remote Sensing Object Detection in Disturbed Environment Based on Improved RTMDet Network

Adversarially-Aware Robust Object Detector.

Reconstruction-Assisted and Distance-Optimized Adversarial Training: A Defense Framework for Remote Sensing Scene Classification

A Robust Adversarial Defense Algorithm for Enhancing Salient Object Detection in Remote Sensing Image

A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking

Adversarial Example Generation Method for Object Detection in Remote Sensing Images

Improving Adversarial Robustness of Detector Via Objectness Regularization

Dual-Branch Sparse Self-Learning with Instance Binding Augmentation for Adversarial Detection in Remote Sensing Images

Adversarial Patch Attack on Multi-Scale Object Detection for UAV Remote Sensing Images

Enhancing Prospective Consistency for Semisupervised Object Detection in Remote-Sensing Images.

Structured Adversarial Self-Supervised Learning for Robust Object Detection in Remote Sensing Images

MOL: Towards Accurate Weakly Supervised Remote Sensing Object Detection Via Multi-view Noisy Learning

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

A Comprehensive Study of the Robustness for LiDAR-Based 3D Object Detectors Against Adversarial Attacks

What's Wrong with the Robustness of Object Detectors?

Deep Active Learning for Remote Sensing Object Detection

RS-YOLOX: A High-Precision Detector for Object Detection in Satellite Remote Sensing Images

Dynamic Loss Decay based Robust Oriented Object Detection on Remote Sensing Images with Noisy Labels

Multiscale Image Splitting Based Feature Enhancement and Instance Difficulty Aware Training for Weakly Supervised Object Detection in Remote Sensing Images