Abstract:Object detection plays a crucial role in scene understanding and has extensive practical applications. In the field of remote sensing object detection, both detection accuracy and robustness are of significant concern. Existing methods heavily rely on sophisticated adversarial training strategies that tend to improve robustness at the expense of accuracy. However, detection robustness is not always indicative of improved accuracy. Therefore, in this article, we research how to enhance robustness, while still preserving high accuracy, or even improve both simultaneously, with simple vanilla adversarial training or even in the absence thereof. In pursuit of a solution, we first conduct an exploratory investigation by shifting our attention from adversarial training, referred to as adversarial fine-tuning, to adversarial pretraining. Specifically, we propose a novel pretraining paradigm, namely, structured adversarial self-supervised (SASS) pretraining, to strengthen both clean accuracy and adversarial robustness for object detection in remote sensing images. At a high level, SASS pretraining aims to unify adversarial learning and self-supervised learning into pretraining and encode structured knowledge into pretrained representations for powerful transferability to downstream detection. Moreover, to fully explore the inherent robustness of vision Transformers and facilitate their pretraining efficiency, by leveraging the recent masked image modeling (MIM) as the pretext task, we further instantiate SASS pretraining into a concise end-to-end framework, named structured adversarial MIM (SA-MIM). SA-MIM consists of two pivotal components: structured adversarial attack and structured MIM (S-MIM). The former establishes structured adversaries for the context of adversarial pretraining, while the latter introduces a structured local-sampling global-masking strategy to adapt to hierarchical encoder architectures. Comprehensive experiments on three different datasets have demonstrated the significant superiority of the proposed pretraining paradigm over previous counterparts for remote sensing object detection. More importantly, regardless of with or without adversarial fine-tuning, it enables simultaneous improvements in detection accuracy and robustness as expected, promisingly alleviating the dependence on complicated adversarial fine-tuning.

Leveraging Permuted Image Restoration for Improved Interpretation of Remote Sensing Images

Remote Sensing Object Detection in Disturbed Environment Based on Improved RTMDet Network

A Pixel Distribution Remapping and Multi-prior Retinex Variational Model for Underwater Image Enhancement

Efficient Image Restoration through Low-Rank Adaptation and Stable Diffusion XL

Rotation-Invariant and Relation-Aware Cross-Domain Adaptation Object Detection Network for Optical Remote Sensing Images

Robust Remote Sensing Scene Interpretation Based on Unsupervised Domain Adaptation

Triply Complementary Priors for Image Restoration.

Pattern Integration and Enhancement Vision Transformer for Self-Supervised Learning in Remote Sensing

Robust Self-Paced Incremental Learning for Multitemporal Remote Sensing Image Classification

Learning Adversarially Robust Object Detector with Consistency Regularization in Remote Sensing Images

Structured Adversarial Self-Supervised Learning for Robust Object Detection in Remote Sensing Images

Learning Spatially Variant Degradation for Unsupervised Blind Photoacoustic Tomography Image Restoration

InfRS: Incremental Few-Shot Object Detection in Remote Sensing Images

A Self-Supplementary and Revised Network for Remote Sensing Object Detection

Debiased Learning for Remote Sensing Data

A Method for Remote Sensing Image Restoration Based on the System Degradation Model

Progressive Attention-Based Feature Recovery With Scribble Supervision for Saliency Detection in Optical Remote Sensing Image

LRSDet: Lightweight Remote Sensing Target Detection Network with Local-Global Information Awareness and Rapid Sample Assignment

DADR: Dual Attention Based Dual Regression Network for Remote Sensing Image Pan-Sharpening

Adaptive weighted multiscale retinex for underwater image enhancement

Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration