Abstract:Adversarial patches exemplify the tangible manifestation of the threat posed by adversarial attacks on Machine Learning (ML) models in real-world scenarios. Robustness against these attacks is of the utmost importance when designing computer vision applications, especially for safety-critical domains such as CCTV systems. In most practical situations, monitoring open spaces requires multi-view systems to overcome acquisition challenges such as occlusion handling. Multiview object systems are able to combine data from multiple views, and reach reliable detection results even in difficult environments. Despite its importance in real-world vision applications, the vulnerability of multiview systems to adversarial patches is not sufficiently investigated. In this paper, we raise the following question: Does the increased performance and information sharing across views offer as a by-product robustness to adversarial patches? We first conduct a preliminary analysis showing promising robustness against off-the-shelf adversarial patches, even in an extreme setting where we consider patches applied to all views by all persons in Wildtrack benchmark. However, we challenged this observation by proposing two new attacks: (i) In the first attack, targeting a multiview CNN, we maximize the global loss by proposing gradient projection to the different views and aggregating the obtained local gradients. (ii) In the second attack, we focus on a Transformer-based multiview framework. In addition to the focal loss, we also maximize the transformer-specific loss by dissipating its attention blocks. Our results show a large degradation in the detection performance of victim multiview systems with our first patch attack reaching an attack success rate of 73% , while our second proposed attack reduced the performance of its target detector by 62%

Targeted View-Invariant Adversarial Perturbations for 3D Object Recognition

One Noise to Rule Them All: Multi-View Adversarial Attacks with Universal Perturbation

Improving Adversarial Robustness of 3D Point Cloud Classification Models

Improving Viewpoint Robustness for Visual Recognition via Adversarial Training

Towards Viewpoint-Invariant Visual Recognition via Adversarial Training

A Comprehensive Study and Comparison of the Robustness of 3D Object Detectors Against Adversarial Attacks

Adversarial Attacks in a Multi-view Setting: An Empirical Study of the Adversarial Patches Inter-view Transferability

Efficient Adversarial Attack Strategy Against 3D Object Detection in Autonomous Driving Systems

Universal Adversarial Attack Against 3D Object Tracking.

Non-Rigid Transformation Based Adversarial Attack Against 3d Object Tracking

Fool the Hydra: Adversarial Attacks against Multi-view Object Detection Systems

Face3DAdv: Exploiting Robust Adversarial 3D Patches on Physical Face Recognition

A Comprehensive Study of the Robustness for LiDAR-Based 3D Object Detectors Against Adversarial Attacks

Physical Adversarial Attack Scheme on Object Detectors using 3D Adversarial Object

On the Adversarial Robustness of Camera-based 3D Object Detection

On Isometry Robustness Of Deep 3d Point Cloud Models Under Adversarial Attacks

Topology-aware Universal Adversarial Attack on 3D Object Tracking

ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpoints

Towards Transferable Targeted 3D Adversarial Attack in the Physical World

Physical-World Optical Adversarial Attacks on 3D Face Recognition

Transient Adversarial 3D Projection Attacks on Object Detection in Autonomous Driving