Abstract:Deep visual graph matching (GM) is a challenging combinatorial task that involves finding a permutation matrix that indicates the correspondence between keypoints from a pair of images. Like many learning systems, empirical studies have shown that visual GM is susceptible to adversarial attacks, with reliability issues in downstream applications. To the best of our knowledge, certifying robustness for deep visual GM remains an open challenge with two main difficulties: how to handle the paired inputs together with the heavily non-linear permutation output space (especially at large scale), and how to balance the trade-off between certified robustness and matching performance. Inspired by the randomized smoothing (RS) technique, we propose the Certified Robustness based on the Optimal Smoothing Range Search (CR-OSRS) technique to fulfill the robustness guarantee for deep visual GM. First, unlike conventional RS methods that use isotropic Gaussian distributions for smoothing, we build the smoothed model with paired joint Gaussian distributions, which capture the structural information among keypoints, and mitigate the performance degradation caused by smoothing. For the vast space of the permutation output, we devise a similarity-based partitioning method that can lower the computational complexity and certification difficulty. We then derive a stringent robustness guarantee that links the certified space of inputs to their corresponding fixed outputs. Second, we design a global optimization method to search for optimal joint Gaussian distributions and facilitate a larger certified space and better performance. Third, we apply data augmentation and a similarity-based regularizer in training to enhance smoothed model performance. Lastly, for the high-dimensional and multivariable nature of the certified space, we propose two methods (sampling and marginal radii) to evaluate it. Experimental results on public benchmarks show that our method achieves state-of-the-art certified robustness.

Appearance and Structure Aware Robust Deep Visual Graph Matching: Attack, Defense and Beyond

Robustness of Deep Learning Models on Graphs: A Survey

Unsupervised Adversarially-Robust Representation Learning on Graphs

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Certified Robustness on Visual Graph Matching Via Searching Optimal Smoothing Range

Certified Robustness on Structural Graph Matching

Integrated Defense for Resilient Graph Matching.

RGM: A Robust Generalizable Matching Model

Revocable Deep Reinforcement Learning with Affinity Regularization for Outlier-Robust Graph Matching

Graph Robustness Benchmark: Benchmarking the Adversarial Robustness of Graph Machine Learning.

RGM: A Robust Generalist Matching Model.

Joint Transformation Learning Via the L2,1-Norm Metric for Robust Graph Matching.

Uncovering Hidden Vulnerabilities in Convolutional Neural Networks through Graph-based Adversarial Robustness Evaluation

Joint Transformation Learning via the L 2,1 -Norm Metric for Robust Graph Matching

AGM: Adaptive Graph Enhanced Graph Matching for Planar Tracking.

Semantically Consistent Visual Representation for Adversarial Robustness

Improving Adversarial Robustness via Attention and Adversarial Logit Pairing

Robust Graph Convolutional Networks with Directional Graph Adversarial Training.

Enhancing Robust Representation in Adversarial Training: Alignment and Exclusion Criteria

Robustness Meets Accuracy in Adversarial Training for Graph Autoencoder

Deep Latent Graph Matching.