Abstract:Supervised cross-modal hashing has attracted many researchers. In these studies, they seek a common semantic space or directly regress the zero-one label information into the Hamming space. Although they achieve many achievements, they neglect some issues: 1) some methods of the classification task are not suitable for retrieval tasks, since they are lack of learning personalized features of sample; 2) the outcomes of hash retrieval are related to both the length and encoding method of hash codes. Because a sample possess more personalized features than label semantics, in this paper, we propose a novel supervised cross-modal hashing collaboration learning method called discrete Cross-modal Hashing with Relaxation and Label Semantic Guidance (CHRLSG). First, we introduce two relaxation variables as latent spaces. One is used to extract text features and label semantic information collaboratively, and the other is used to extract image features and label semantics collaboratively. Second, the more accurate hash codes are generated from latent spaces, since CHRLSG learns collaboratively feature semantics and label semantics by using labels as the domination and features as the auxiliary. Third, we utilize labels to strengthen the similar relationship of inter-modal samples via keeping the pairwise closeness. Label semantics are made full use of to avoid classification error. Fourth, we introduce class weight to further increase the discrimination of samples that belong to different classes in intra-modal and keep the similarity of samples unchanged. Therefore, CHRLSG model preserves not only the relationship between samples, but also maintains the consistency of label semantic during collaboration optimization. Experimental results of three common benchmark datasets demonstrate that the proposed model is superior to the existing advanced methods.

Discrete cross-modal hashing with relaxation and label semantic guidance

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Exploiting Subspace Relation in Semantic Labels for Cross-Modal Hashing

Supervised Cross-Modal Hashing Without Relaxation

Semi-Relaxation Supervised Hashing for Cross-Modal Retrieval.

Label consistent locally linear embedding based cross-modal hashing

Semi-supervised Semi-paired Cross-modal Hashing

Discrete Two-Step Cross-Modal Hashing Through the Exploitation of Pairwise Relations

Label Guided Discrete Hashing for Cross-Modal Retrieval.

Semantic-consistent cross-modal hashing for large-scale image retrieval

Supervised Contrastive Discrete Hashing for Cross-Modal Retrieval

Fast Discrete Cross-modal Hashing with Regressing from Semantic Labels.

Semi-Supervised Semantic-Preserving Hashing For Efficient Cross-Modal Retrieval

Deep Discrete Cross-Modal Hashing with Multiple Supervision

Deep Cross-modal Hashing via Margin-dynamic-softmax Loss

Semantic-Guided Hashing for Cross-Modal Retrieval

Deep Cross-modal Hashing Based on Semantic Consistent Ranking

Pseudo-label driven deep hashing for unsupervised cross-modal retrieval

S3ACH: Semi-Supervised Semantic Adaptive Cross-Modal Hashing