Abstract:Multi-modal hashing is an effective technique to support large-scale multimedia retrieval, due to its capability of encoding heterogeneous multi-modal features into compact and similarity-preserving binary codes. Although great progress has been achieved so far, existing methods still suffer from several problems, including: 1) All existing methods simply adopt fixed modality combination weights in online hashing process to generate the query hash codes. This strategy cannot adaptively capture the variations of different queries. 2) They either suffer from insufficient semantics (for unsupervised methods) or require high computation and storage cost (for the supervised methods, which rely on pair-wise semantic matrix). 3) They solve the hash codes with relaxed optimization strategy or bit-by-bit discrete optimization, which results in significant quantization loss or consumes considerable computation time. To address the above limitations, in this paper, we propose an Online Multi-modal Hashing with Dynamic Query-adaption (OMH-DQ) method in a novel fashion. Specifically, a self-weighted fusion strategy is designed to adaptively preserve the multi-modal feature information into hash codes by exploiting their complementarity. The hash codes are learned with the supervision of pair-wise semantic labels to enhance their discriminative capability, while avoiding the challenging symmetric similarity matrix factorization. Under such learning framework, the binary hash codes can be directly obtained with efficient operations and without quantization errors. Accordingly, our method can benefit from the semantic labels, and simultaneously, avoid the high computation complexity. Moreover, to accurately capture the query variations, at the online retrieval stage, we design a parameter-free online hashing module which can adaptively learn the query hash codes according to the dynamic query contents. Extensive experiments demonstrate the state-of-the-art performance of the proposed approach from various aspects.

POLISH: Adaptive Online Cross-Modal Hashing for Class Incremental Data

Discrete Similarity Preserving Hashing for Cross-modal Retrieval.

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Online latent semantic hashing for cross-media retrieval.

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Efficient Online Label Consistent Hashing for Large-Scale Cross-Modal Retrieval.

Online Cross-modal Hashing With Dynamic Prototype

Online Discriminative Cross-modal Hashing

OLCH: Online Label Consistent Hashing for streaming cross-modal retrieval

Supervised Hierarchical Online Hashing for Cross-modal Retrieval

Scalable Discrete and Asymmetric Unequal Length Hashing Learning for Cross-Modal Retrieval

Semantic embedding based online cross-modal hashing method

Label-Semantic-Enhanced Online Hashing for Efficient Cross-modal Retrieval

OMGH: Online Manifold-Guided Hashing for Flexible Cross-modal Retrieval

A High-Dimensional Sparse Hashing Framework for Cross-Modal Retrieval

Data-Aware Proxy Hashing for Cross-modal Retrieval

SCH: Symmetric Consistent Hashing for Cross-Modal Retrieval

Online Multi-modal Hashing with Dynamic Query-adaption

An efficient dual semantic preserving hashing for cross-modal retrieval

Online supervised collective matrix factorization hashing for cross-modal retrieval