Abstract:<p>Similarity learning is a kind of machine learning algorithm that aims to measure the relevance between given objects. However, conventional similarity learning algorithms usually measure the distance between the entire given objects in the latent feature space. Consequently, the obtained similarity scores only represent how close are the entire given objects, but are incapable of demonstrating which part of them are similar to each other and how semantically similar are they. To address the above problems, in this paper, we propose a self-attention driven adversarial similarity learning network. Discriminative self-attention weights are firstly assigned to different regions of the given objects. The similarity learning step measures the relevance between these self-attention weighted feature maps of given objects under various topic vectors. The topic vectors are conditioned to capture and preserve hidden semantic information within data distribution by a generator-discriminator model with adversarial loss. This model aims to generate objects from topic vectors and propagates the difference between the generated and the real objects back to the similarity learning step, which forces the topic vectors to not only assign discriminative similarity scores to different object pairs but also further mine the hidden semantic information within data distribution. The final similarity scores represent how tight the given objects are connected to the topics. In addition, the regions with higher self-attention weights make more contribution to the discriminative similarity scores. The effectiveness of the proposed method is demonstrated through evaluations based on image retrieval task and document retrieval task and compared against various state-of-the-art algorithms in the field. The visualization results of topic vectors and self-attention weighted feature maps are demonstrated to make our proposed method explainable.</p>

Hierarchical Deep Multi-task Learning with Attention Mechanism for Similarity Learning

H2MN: Graph Similarity Learning with Hierarchical Hypergraph Matching Networks.

Hierarchical Task-aware Multi-Head Attention Network

Hierarchical Inter-Attention Network for Document Classification with Multi-Task Learning.

Saliency-Regularized Deep Multi-Task Learning

Deep Multi-Task Augmented Feature Learning via Hierarchical Graph Neural Network

Deep Multi-task Learning for Hierarchical Classification

An end-to-end heterogeneous network for graph similarity learning

Hierarchical Large-scale Graph Similarity Computation via Graph Coarsening and Matching

Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification

HD-MTL: Hierarchical Deep Multi-Task Learning for Large-Scale Visual Recognition

Hierarchical multiples self-attention mechanism for multi-modal analysis

Adaptive dual graph regularization for clustered multi-task learning

Multiple Relational Attention Network for Multi-task Learning

Hierarchical and Fast Graph Similarity Computation Via Graph Coarsening and Deep Graph Learning.

HirMTL: Hierarchical Multi-Task Learning for dense scene understanding

Composite attention mechanism network for deep contrastive multi-view clustering

Adaptively Sharing Multi-Levels of Distributed Representations in Multi-Task Learning

Exploring Attention Mechanism for Graph Similarity Learning

Self-attention driven adversarial similarity learning network

On Better Exploring and Exploiting Task Relationships in Multitask Learning: Joint Model and Feature Learning.