Abstract:Deep learning methods have been proven effective in remote sensing image analysis and interpretation, where semantic segmentation plays a vital role. These deep segmentation methods are susceptible to adversarial attacks, while most of the existing attack methods tend to manipulate the image globally, leading to noticeable perturbations and chaotic segmentation. In this work, we propose a novel stealthy attack for semantic segmentation (SASS), which can largely increase the effectiveness and stealthiness from the existing attack methods on remote sensing images. SASS manipulates specific victim classes or objects of interest while preserving the original segmentation results for other classes or objects. In practice, as different inference mechanisms, overlapped inference, can be applied in segmentation, the efficacy of SASS may be degraded. To this end, we further introduce the masked SASS (MSASS), which generates augmented adversarial perturbations that only affect victim areas. We evaluate the effectiveness of SASS and MSASS using four state-of-the-art semantic segmentation models on the Vaihingen and Zurich Summer datasets. Extensive experiments demonstrate that our SASS and MSASS methods achieve superior attack performances on victim areas while maintaining high accuracies of other areas (drop less than 2%). The detection success rates of adversarial examples for segmentation, as characterized by Xiao et al., significantly drop from 97.78% for the untargeted projected gradient descent (PGD) attack to 28.71% for our MSASS method on the Zurich Summer dataset. Our work contributes to the field of adversarial attacks in semantic segmentation for remote sensing images by improving stealthiness, flexibility, and robustness. We anticipate that our findings will inspire the development of defense methods to enhance the security and reliability of semantic segmentation models against our stealthy attack.

Improve Adversarial Robustness of AI Models in Remote Sensing via Data-Augmentation and Explainable-AI Methods

Boosting Adversarial Training in Safety-Critical Systems Through Boundary Data Selection

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

Improving Adversarial Robustness of 3D Point Cloud Classification Models

Universal Adversarial Defense in Remote Sensing Based on Pre-trained Denoising Diffusion Models

Combining AI Control Systems and Human Decision Support via Robustness and Criticality

A Reliable Approach for Generating Realistic Adversarial Attack via Trust Region-Based Optimization

An Empirical Study of Adversarial Examples on Remote Sensing Image Scene Classification

Adversarial attacks and defenses in explainable artificial intelligence: A survey

AI Security for Geoscience and Remote Sensing: Challenges and Future Trends

Adversarial Attack for Explanation Robustness of Rationalization Models

Stealthy Adversarial Examples for Semantic Segmentation in Remote Sensing

Adversarial Examples in Remote Sensing

On the Trade-offs between Adversarial Robustness and Actionable Explanations

Scattering Model Guided Adversarial Examples for SAR Target Recognition: Attack and Defense

Sub-Band Backdoor Attack in Remote Sensing Imagery

Impact of Architectural Modifications on Deep Learning Adversarial Robustness

Robust Remote Sensing Scene Interpretation Based on Unsupervised Domain Adaptation

Robustness in deep learning models for medical diagnostics: security and adversarial challenges towards robust AI applications

TXAI-ADV: Trustworthy XAI for Defending AI Models against Adversarial Attacks in Realistic CIoT

Investigating Adversarial Attacks in Software Analytics via Machine Learning Explainability