Abstract:Deep cross-modal hashing has achieved excellent retrieval performance with the powerful representation capability of deep neural networks. Regrettably, current methods are inevitably vulnerable to adversarial attacks, especially well-designed subtle perturbations that can easily fool deep cross-modal hashing models into returning irrelevant or the attacker’s specified results. Although adversarial attacks have attracted increasing attention, there are few studies on specialized attacks against deep cross-modal hashing. To solve these issues, we propose a targeted adversarial attack method against deep cross-modal hashing retrieval in this paper. To the best of our knowledge, this is the first work in this research field. Concretely, we first build a progressive fusion module to extract fine-grained target semantics through a progressive attention mechanism. Meanwhile, we design a semantic adaptation network to generate the target prototype code and reconstruct the category label, thus realizing the semantic interaction between the target semantics and the implicit semantics of the attacked model. To bridge modality gaps and preserve local example details, a semantic translator seamlessly translates the target semantics and then embeds them into benign examples in collaboration with a U-Net framework. Moreover, we construct a discriminator for adversarial training, which enhances the visual realism and category discrimination of adversarial examples, thus improving their targeted attack performance. Extensive experiments on widely tested cross-modal retrieval datasets demonstrate the superiority of our proposed method. Also, transferable attacks show that our generated adversarial examples have well generalization capability on targeted attacks. The source codes and datasets are available at https://github.com/tswang0116/TA-DCH.

Exploiting Topic-Based Adversarial Neural Network for Cross-Domain Keyphrase Extraction

Training NLI Models Through Universal Adversarial Attack

Topic Driven Adaptive Network for cross-domain sentiment classification

Neural Topic Modeling with Bidirectional Adversarial Training

Unsupervised cross-domain named entity recognition using entity-aware adversarial training

AdaptiveUKE: Towards adaptive unsupervised keyphrase extraction with gated topic modeling

Neural Topic Modeling with Cycle-Consistent Adversarial Training

Cross-Domain Keyword Extraction with Keyness Patterns

Neural Adaptation Layers for Cross-domain Named Entity Recognition

Cross-Domain Robustness of Transformer-based Keyphrase Generation

Targeted Adversarial Attack against Deep Cross-modal Hashing Retrieval

Scientific Keyphrase Extraction: Extracting Candidates with Semi-supervised Data Augmentation.

What's in a Domain? Learning Domain-Robust Text Representations using Adversarial Training

Cross-domain Co-Extraction of Sentiment and Topic Lexicons

Towards Improving Adversarial Training of NLP Models

A survey on neural topic models: methods, applications, and challenges

TAN-NTM: Topic Attention Networks for Neural Topic Modeling

Enhancing Model Robustness By Incorporating Adversarial Knowledge Into Semantic Representation

Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation

Chinese keyword extraction model with distributed computing