Abstract:As an important method of image classification, Open-Set Recognition (OSR) has been gradually deployed in autonomous driving systems (ADSs) for detecting the surrounding environment with unknown objects. To date, many researchers have demonstrated that the existing OSR classifiers are heavily threatened by adversarial input images. Nevertheless, most existing attack approaches are based on white-box attacks, assuming that information of the target OSR model is known by the attackers. Hence, these attack models cannot effectively attack ADSs that keep models and data confidential. To facilitate the design of future generations of robust OSR classifiers for safer ADSs, we introduce a practical black-box adversarial attack. First, we simulate a real-world open-set environment by reasonable dataset division. Second, we train a substitute model, in which, to improve the transferability of the adversarial data, we combine dynamic convolution into the substitute model. Finally, we use the substitute model to generate adversarial data to attack the target model. To the best of the authors' knowledge, the proposed attack model is the first to utilize dynamic convolution to improve the transferability of adversarial data. To evaluate the proposed attack model, we conduct extensive experiments on four publicly available datasets. The numerical results show that, compared to the white-box attack approaches, the proposed black-box attack approach has a similar attack capability. Specifically, using the German Traffic Sign Recognition Benchmark dataset, our model can decrease the classification accuracy of known classes from 99.8% to 9.81% and can decrease the AUC of detecting unknown classes from 97.7% to 48.8%.

Universal Adversarial Attacks for Visual Odometry Systems

Adversarial Computer Vision Via Acoustic Manipulation of Camera Sensors

Poltergeist: Acoustic Adversarial Machine Learning against Cameras and Computer Vision

Adversarial Robustness Analysis of LiDAR-included Models in Autonomous Driving

Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics

Counteracting Adversarial Attacks in Autonomous Driving

Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles

Adversarial Attacks on Monocular Depth Estimation

Attacking vision-based perception in end-to-end autonomous driving models

Exploring the Adversarial Robustness of Video Object Segmentation Via One-shot Adversarial Attacks

Adversarial Examples in Visual Object Tracking in Satellite Videos: Cross-Frame Momentum Accumulation for Adversarial Examples Generation

Detection of Adversarial Physical Attacks in Time-Series Image Data

Adversarial Attacks on Monocular Pose Estimation

AdvDO: Realistic Adversarial Attacks for Trajectory Prediction

Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving

Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey

Practical black-box adversarial attack on open-set recognition: Towards robust autonomous driving

Pluggable Attack for Visual Object Tracking

Unsupervised cycle-consistent adversarial attacks for visual object tracking

PG-Attack: A Precision-Guided Adversarial Attack Framework Against Vision Foundation Models for Autonomous Driving

Adversarial Attack and Defense of YOLO Detectors in Autonomous Driving Scenarios