Establishment and maintenance of cell suspension cultures.

Jaideep Mathur,Csaba Koncz

DOI: https://doi.org/10.1385/0-89603-391-0:27

Abstract:

What problem does this paper attempt to address?

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Dekui Ma,Jian Liang,Xiangwei Kong,Ran He,Ying Li

DOI: https://doi.org/10.1109/ism.2016.0017

2016-01-01

Abstract:Hashing techniques have been widely adopted for cross-modal retrieval due to its low storage cost and fast query speed. Most existing cross-modal hashing methods aim to map heterogeneous data into the common low-dimensional hamming space and then threshold to obtain binary codes by relaxing the discrete constraint. However, this independent relaxation step also brings quantization errors, resulting in poor retrieval performances. Other cross-modal hashing methods try to directly optimize the challenging objective function with discrete binary constraints. Inspired by [1], we propose a novel supervised cross-modal hashing method called Discrete Cross-Modal Hashing (DCMH) to learn the discrete binary codes without relaxing them. DCMH is formulated through reconstructing the semantic similarity matrix and learning binary codes as ideal features for classification. Furthermore, DCMH alternately updates binary codes of each modality, and iteratively learns the discrete hashing codes bit by bit efficiently, which is quite promising for large-scale datasets. Extensive empirical results on three real-world datasets show that DCMH outperforms the baseline approaches significantly.
Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Tao Yao,Yaru Han,Ruxin Wang,Xiangwei Kong,Lianshan Yan,Haiyan Fu,Qi Tian

DOI: https://doi.org/10.1016/j.neucom.2019.12.086

IF: 6

2019-01-01

Neurocomputing

Abstract:Supervised cross-modal hashing has gained increasing research interest on large-scale retrieval task owning to its satisfactory performance and efficiency. However, there are still some issues to be further addressed: (1) most of them fail to capture the inherent data structure effectively due to the complex correlations among heterogeneous data points; (2) most of them obtain continuous solutions firstly and then quantize the continuous solutions to generate hash codes directly, which causes large quantization error and consequent suboptimal retrieval performance; (3) most of them suffer from relatively high memory cost and computational complexity during training procedure, which makes them unscalable. In this paper, to address above issues, we propose a supervised hashing method for cross-modal retrieval dubbed Efficient Discrete Supervised Hashing (EDSH). Specifically, the sharing space learning with collective matrix factorization and semantic embedding with class labels are seamlessly integrated to learn hash codes. Therefore, the feature based similarities and semantic correlations are both preserved in hash codes, which makes the learned hash codes more discriminative. Then an efficient discrete optimal scheme is designed to handle the scalable issue. Instead of learning hash codes bit-by-bit, hash codes matrix can be obtained directly which is more efficient. Extensive experimental results on three public datasets show that our EDSH produces a superior performance in both accuracy and scalability over several existing cross-modal hashing approaches.
Frustratingly Easy Cross-Modal Hashing

Dekui Ma,Jian Liang,Xiangwei Kong,Ran He

DOI: https://doi.org/10.1145/2964284.2967218

2016-01-01

Abstract:Cross-modal hashing has attracted considerable attention due to its low storage cost and fast retrieval speed. Recently, more and more sophisticated researches related to this topic are proposed. However, they seem to be inefficient computationally for several reasons. On one hand, learning coupled hash projections makes the iterative optimization problem challenging. On the other hand, individual collective binary codes for each content are also learned with a high computation complexity. In this paper we describe a simple yet effective cross-modal hashing approach that can be implemented in just three lines of code. This approach first obtains the binary codes for one modality via unimodal hashing methods (e.g., iterative quantization (ITQ)), then applies simple linear regression to project the other modalities into the obtained binary subspace. Obviously, it is non-iterative and parameter-free, which makes it more attractive for many real-world applications. We further compare our approach with other state-of-the-art methods on four benchmark datasets (i.e., the Wiki, VOC, LabelMe and NUS-WIDE datasets). Despite its extraordinary simplicity, our approach performs remarkably and generally well for these datasets under different experimental settings (i.e., large-scale, high-dimensional and multi-label datasets).
Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Dekui Ma,Jian Liang,Ran He,Xiangwei Kong

DOI: https://doi.org/10.1109/mmul.2017.28

IF: 3.4911

2017-01-01

IEEE Multimedia

Abstract:Hashing techniques have been widely adopted for cross-modal retrieval due to their low storage cost and fast query speed. Recently, some unimodal hashing methods have tried to directly optimize the objective function with discrete binary constraints. Inspired by these methods, the authors propose a novel supervised cross-modal hashing method called Discrete Cross-Modal Hashing (DCMH) to learn the binary codes without relaxing them. DCMH is formulated through semantic similarity reconstruction, and it learns binary codes for use as ideal features for classification. Furthermore, DCMH alternately updates binary codes for each modality, and its discrete hashing codes are learned efficiently, bit by bit, which is quite promising for large-scale datasets. To evaluate the effectiveness of the proposed discrete optimization, the authors optimize their objective function in a relax-and-threshold manner. Extensive empirical results on both image-text and image-tag datasets demonstrate that DCMH is a significant improvement over previous approaches in terms of training time and retrieval performance.
Semantic Consistency Hashing for Cross-Modal Retrieval

Tao Yao,Xiangwei Kong,Haiyan Fu,Qi Tian

DOI: https://doi.org/10.1016/j.neucom.2016.02.016

IF: 6

2016-01-01

Neurocomputing

Abstract:The task of cross-modal retrieval is to query similar objects in dataset of multi-modality, such as using text to query images and vice versa. However, most of existing works suffer from high computational complexity and storage cost in large-scale applications. Recently, hashing method mapping the high-dimensional data to compact binary codes has attracted a lot of concerns due to its efficiency and low storage cost over large-scale dataset. In this paper, we propose a Semantic Consistency Hashing (SCH) method for cross-modal retrieval. SCH learns a shared semantic space simultaneously taking both inter-modal and intra-modal semantic correlations into account. In order to preserve the inter-modal semantic consistency, an identical representation is learned using non-negative matrix factorization for the samples with different modalities. Meanwhile, neighbor preserving algorithm is adopted to preserve the semantic consistency in each modality. In addition, an effective optimal algorithm is proposed to reduce the time complexity from traditional O(N2) or higher to O(N). Extensive experiments on two public datasets demonstrate that the proposed approach significantly outperforms the existing schemes.
Collective Matrix Factorization Hashing for Multimodal Data

Guiguang Ding,Yuchen Guo,Jile Zhou

DOI: https://doi.org/10.1109/cvpr.2014.267

2014-01-01

Abstract:Nearest neighbor search methods based on hashing have attracted considerable attention for effective and efficient large-scale similarity search in computer vision and information retrieval community. In this paper, we study the problems of learning hash functions in the context of multimodal data for cross-view similarity search. We put forward a novel hashing method, which is referred to Collective Matrix Factorization Hashing (CMFH). CMFH learns unified hash codes by collective matrix factorization with latent factor model from different modalities of one instance, which can not only supports cross-view search but also increases the search accuracy by merging multiple view information sources. We also prove that CMFH, a similarity-preserving hashing learning method, has upper and lower boundaries. Extensive experiments verify that CMFH significantly outperforms several state-of-the-art methods on three different datasets.
Unsupervised Deep Hashing Via Binary Latent Factor Models for Large-scale Cross-modal Retrieval

Gengshen Wu,Zijia Lin,Jungong Han,Li Liu,Guiguang Ding,Baochang Zhang,Jialie Shen

DOI: https://doi.org/10.24963/ijcai.2018/396

2018-01-01

Abstract:Despite its great success, matrix factorization based cross-modality hashing suffers from two problems: 1) there is no engagement between feature learning and binarization; and 2) most existing methods impose the relaxation strategy by discarding the discrete constraints when learning the hash function, which usually yields suboptimal solutions. In this paper, we propose a novel multimodal hashing framework, referred as Unsupervised Deep Cross-Modal Hashing (UDCMH), for multimodal data search in a self-taught manner via integrating deep learning and matrix factorization with binary latent factor models. On one hand, our unsupervised deep learning framework enables the feature learning to be jointly optimized with the binarization. On the other hand, the hashing system based on the binary latent factor models can generate unified binary codes by solving a discrete-constrained objective function directly with no need for a relaxation step. Moreover, novel Laplacian constraints are incorporated into the objective function, which allow to preserve not only the nearest neighbors that are commonly considered in the literature but also the farthest neighbors of data, even if the semantic labels are not available. Extensive experiments on multiple datasets highlight the superiority of the proposed framework over several state-of-the-art baselines.
Online supervised collective matrix factorization hashing for cross-modal retrieval

Zhenqiu Shu,Li Li,Jun Yu,Donglin Zhang,Zhengtao Yu,Xiao-Jun Wu

DOI: https://doi.org/10.1007/s10489-022-04189-6

IF: 5.3

2022-10-24

Applied Intelligence

Abstract:Recently, online hashing has received extensive attention in cross-modal retrieval since it can effectively deal with large-scale streaming data. However, some of them in online cross-modal retrieval still have the following limitations: (1) They cannot take full advantage of the supervision information among the data in some cases. (2) The hash codes learned from online hashing methods only preserve the shared properties of multi-modal data, and neglect the specific properties of each modality. To solve the above issues, we propose a novel supervised online cross-modal retrieval hashing method, i.e., Online Supervised Collective Matrix Factorization Hashing(OSCMFH). OSCMFH utilizes semantic labels to obtain the shared and specific latent semantic representation of all modalities of new data. Meanwhile, the latent semantic representation of old data is adaptively updated by the newly updated hash model without accessing the old data. Furthermore, the hash codes can be generated by quantifying the combination of the latent semantic representation of new and old data. Therefore, the hash codes not only embed the semantic information of multi-modality data but also keep the shared and specific properties of multi-modal data. We conduct extensive experiments on four benchmark datasets to demonstrate the effectiveness of our OSCMFH algorithm compared with other state-of-the-art online learning algorithms.

computer science, artificial intelligence
Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval

Li Liu,Zijia Lin,Ling Shao,Fumin Shen,Guiguang Ding,Jungong Han

DOI: https://doi.org/10.1109/tip.2016.2619262

IF: 10.6

2017-01-01

IEEE Transactions on Image Processing

Abstract:With the dramatic development of the Internet, how to exploit large-scale retrieval techniques for multimodal web data has become one of the most popular but challenging problems in computer vision and multimedia. Recently, hashing methods are used for fast nearest neighbor search in large-scale data spaces, by embedding high-dimensional feature descriptors into a similarity preserving Hamming space with a low dimension. Inspired by this, in this paper, we introduce a novel supervised cross-modality hashing framework, which can generate unified binary codes for instances represented in different modalities. Particularly, in the learning phase, each bit of a code can be sequentially learned with a discrete optimization scheme that jointly minimizes its empirical loss based on a boosting strategy. In a bitwise manner, hash functions are then learned for each modality, mapping the corresponding representations into unified hash codes. We regard this approach as cross-modality sequential discrete hashing (CSDH), which can effectively reduce the quantization errors arisen in the oversimplified rounding-off step and thus lead to high-quality binary codes. In the test phase, a simple fusion scheme is utilized to generate a unified hash code for final retrieval by merging the predicted hashing results of an unseen instance from different modalities. The proposed CSDH has been systematically evaluated on three standard data sets: Wiki, MIRFlickr, and NUS-WIDE, and the results show that our method significantly outperforms the state-of-the-art multimodality hashing techniques.
MTFH: A Matrix Tri-Factorization Hashing Framework for Efficient Cross-Modal Retrieval

Xin Liu,Zhikai Hu,Haibin Ling,Yiu-Ming Cheung

DOI: https://doi.org/10.1109/tpami.2019.2940446

IF: 23.6

2021-03-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Hashing has recently sparked a great revolution in cross-modal retrieval because of its low storage cost and high query speed. Recent cross-modal hashing methods often learn unified or equal-length hash codes to represent the multi-modal data and make them intuitively comparable. However, such unified or equal-length hash representations could inherently sacrifice their representation scalability because the data from different modalities may not have one-to-one correspondence and could be encoded more efficiently by different hash codes of unequal lengths. To mitigate these problems, this paper exploits a related and relatively unexplored problem: encode the heterogeneous data with varying hash lengths and generalize the cross-modal retrieval in various challenging scenarios. To this end, a generalized and flexible cross-modal hashing framework, termed Matrix Tri-Factorization Hashing (MTFH), is proposed to work seamlessly in various settings including paired or unpaired multi-modal data, and equal or varying hash length encoding scenarios. More specifically, MTFH exploits an efficient objective function to flexibly learn the modality-specific hash codes with different length settings, while synchronously learning two semantic correlation matrices to semantically correlate the different hash representations for heterogeneous data comparable. As a result, the derived hash codes are more semantically meaningful for various challenging cross-modal retrieval tasks. Extensive experiments evaluated on public benchmark datasets highlight the superiority of MTFH under various retrieval scenarios and show its competitive performance with the state-of-the-arts.

computer science, artificial intelligence,engineering, electrical & electronic
Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

Jun Yu,Xiao-Jun Wu,Donglin Zhang

DOI: https://doi.org/10.1007/s12559-021-09847-4

IF: 4.89

2021-03-04

Cognitive Computation

Abstract:The explosive growth of multimedia data on the Internet has magnified the challenge of information retrieval. Multimedia data usually emerges in different modalities, such as image, text, video, and audio. Unsupervised cross-modal hashing techniques that support searching among multi-modal data have gained importance in large-scale retrieval tasks because of the advantage of low storage cost and high efficiency. Current methods learn the hash functions by transforming high-dimensional data into discrete hash codes. However, the original manifold structure and semantic correlation are not preserved well in compact hash codes. We propose a novel unsupervised cross-modal hashing method to cope with this problem from two perspectives. On the one hand, the semantic correlation in textual space and the locally geometric structure in the visual space are reconstructed by unified hashing features seamlessly and simultaneously. On the other hand, the $\ell _{2,1}$-norm penalties are imposed on the projection matrices separately to learn the relevant and discriminative hash codes. The experimental results indicate that our proposed method achieves an improvement of 1%, 6%, 9%, and 2% over the best comparison method on the four publicly available datasets (WiKi, PASCAL-VOC, UCI Handwritten Digit, and NUS-WIDE), respectively. In conclusion, the proposed framework which combines hash functions learning and multimodal graph embedding is effective in learning hash codes and achieves superior retrieval performance compared to state-of-the-art methods.

computer science, artificial intelligence,neurosciences
Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval

Min Meng,Haitao Wang,Jun Yu,Hui Chen,Jigang Wu

DOI: https://doi.org/10.1109/tip.2020.3038365

IF: 10.6

2021-01-01

IEEE Transactions on Image Processing

Abstract:Hashing-based techniques have provided attractive solutions to cross-modal similarity search when addressing vast quantities of multimedia data. However, existing cross-modal hashing (CMH) methods face two critical limitations: 1) there is no previous work that simultaneously exploits the consistent or modality-specific information of multi-modal data; 2) the discriminative capabilities of pairwise similarity is usually neglected due to the computational cost and storage overhead. Moreover, to tackle the discrete constraints, relaxation-based strategy is typically adopted to relax the discrete problem to the continuous one, which severely suffers from large quantization errors and leads to sub-optimal solutions. To overcome the above limitations, in this article, we present a novel supervised CMH method, namely Asymmetric Supervised Consistent and Specific Hashing (ASCSH). Specifically, we explicitly decompose the mapping matrices into the consistent and modality-specific ones to sufficiently exploit the intrinsic correlation between different modalities. Meanwhile, a novel discrete asymmetric framework is proposed to fully explore the supervised information, in which the pairwise similarity and semantic labels are jointly formulated to guide the hash code learning process. Unlike existing asymmetric methods, the discrete asymmetric structure developed is capable of solving the binary constraint problem discretely and efficiently without any relaxation. To validate the effectiveness of the proposed approach, extensive experiments on three widely used datasets are conducted and encouraging results demonstrate the superiority of ASCSH over other state-of-the-art CMH methods.

computer science, artificial intelligence,engineering, electrical & electronic
Online Collective Matrix Factorization Hashing for Large-Scale Cross-Media Retrieval

Di Wang,Quan Wang,Yaqiang An,Xinbo Gao,Yumin Tian

DOI: https://doi.org/10.1145/3397271.3401132

2020-07-25

Abstract:Cross-modal hashing has been widely investigated recently for its efficiency in large-scale cross-media retrieval. However, most existing cross-modal hashing methods learn hash functions in a batch-based learning mode. Such mode is not suitable for large-scale data sets due to the large memory consumption and loses its efficiency when training streaming data. Online cross-modal hashing can deal with the above problems by learning hash model in an online learning process. However, existing online cross-modal hashing methods cannot update hash codes of old data by the newly learned model. In this paper, we propose Online Collective Matrix Factorization Hashing (OCMFH) based on collective matrix factorization hashing (CMFH), which can adaptively update hash codes of old data according to dynamic changes of hash model without accessing to old data. Specifically, it learns discriminative hash codes for streaming data by collective matrix factorization in an online optimization scheme. Unlike conventional CMFH which needs to load the entire data points into memory, the proposed OCMFH retrains hash functions only by newly arriving data points. Meanwhile, it generates hash codes of new data and updates hash codes of old data by the latest updated hash model. In such way, hash codes of new data and old data are well-matched. Furthermore, a zero mean strategy is developed to solve the mean-varying problem in the online hash learning process. Extensive experiments on three benchmark data sets demonstrate the effectiveness and efficiency of OCMFH on online cross-media retrieval.
Cross-Modal Hashing by Lp-Norm Multiple Subgraph Combination

Dongxiao Ren,Junwei Huang,Zhonghua Wang,Fang Lu

DOI: https://doi.org/10.1109/access.2021.3052605

IF: 3.9

2021-01-01

IEEE Access

Abstract:With the explosion of multi-modal Web data, effective and efficient techniques are in urgent need for cross-modal data retrieval with relevant semantics. Among all the possible solutions, the hashing techniques provide compact and measurable binary representation, thus gain much attention in related research domain. To better deal with diversified real world data, we propose MSC, a novel cross-modal hashing approach based on the generalized $l_{p}$ -norm Multiple Subgraph Combination. Specifically, by jointly considering the content similarity, the correspondence and other weak correlation among cross-modal documents, we build the intra-modal similarity with multiple affinity subgraphs, and encode the inter-modal correlation with a bipartite subgraph. Then these subgraphs are combined into one multi-modal similarity graph for all the data from heterogeneous modalities, where the weights of multiple intra-modal visual similarity subgraphs are regularized by $l_{p}$ -norm penalty. The optimal hash codes and the combination coefficients are learned simultaneously by efficient alternating optimization. The hash functions for different modalities are learned separately by utilizing nonlinear classification models, encoding the complicated semantic relations among cross-modal data. Experiments on challenging real world datasets demonstrate the advantage of our method over existing approaches.
Adaptive Marginalized Semantic Hashing for Unpaired Cross-Modal Retrieval

Kaiyi Luo,Chao Zhang,Huaxiong Li,Xiuyi Jia,Chunlin Chen

DOI: https://doi.org/10.1109/TMM.2023.3245400

2022-07-25

Abstract:In recent years, Cross-Modal Hashing (CMH) has aroused much attention due to its fast query speed and efficient storage. Previous literatures have achieved promising results for Cross-Modal Retrieval (CMR) by discovering discriminative hash codes and modality-specific hash functions. Nonetheless, most existing CMR works are subjected to some restrictions: 1) It is assumed that data of different modalities are fully paired, which is impractical in real applications due to sample missing and false data alignment, and 2) binary regression targets including the label matrix and binary codes are too rigid to effectively learn semantic-preserving hash codes and hash functions. To address these problems, this paper proposes an Adaptive Marginalized Semantic Hashing (AMSH) method which not only enhances the discrimination of latent representations and hash codes by adaptive margins, but also can be used for both paired and unpaired CMR. As a two-step method, in the first step, AMSH generates semantic-aware modality-specific latent representations with adaptively marginalized labels, which enlarges the distances between different classes, and exploits the labels to preserve the inter-modal and intra-modal semantic similarities into latent representations and hash codes. In the second step, adaptive margin matrices are embedded into the hash codes, and enlarge the gaps between positive and negative bits, which improves the discrimination and robustness of hash functions. On this basis, AMSH generates similarity-preserving hash codes and robust hash functions without strict one-to-one data correspondence requirement. Experiments are conducted on several benchmark datasets to demonstrate the superiority and flexibility of AMSH over some state-of-the-art CMR methods.

Multimedia
Large-Scale Supervised Multimodal Hashing with Semantic Correlation Maximization

Dongqing Zhang,Wu-Jun Li

DOI: https://doi.org/10.1609/aaai.v28i1.8995

2014-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Due to its low storage cost and fast query speed, hashing has been widely adopted for similarity search in multimedia data. In particular, more and more attentions have been payed to multimodal hashing for search in multimedia data with multiple modalities, such as images with tags. Typically, supervised information of semantic labels is also available for the data points in many real applications. Hence, many supervised multimodal hashing~(SMH) methods have been proposed to utilize such semantic labels to further improve the search accuracy. However, the training time complexity of most existing SMH methods is too high, which makes them unscalable to large-scale datasets. In this paper, a novel SMH method, called semantic correlation maximization~(SCM), is proposed to seamlessly integrate semantic labels into the hashing learning procedure for large-scale data modeling. Experimental results on two real-world datasets show that SCM can significantly outperform the state-of-the-art SMH methods, in terms of both accuracy and scalability.
Multi-Relational Deep Hashing for Cross-Modal Search

Xiao Liang,Erkun Yang,Yanhua Yang,Cheng Deng

DOI: https://doi.org/10.1109/tip.2024.3385656

IF: 10.6

2024-04-27

IEEE Transactions on Image Processing

Abstract:Deep cross-modal hashing retrieval has recently made significant progress. However, existing methods generally learn hash functions with pairwise or triplet supervisions, which involves learning the relevant information by splicing partial similarity between data pairs; notably, this approach only captures the data similarity locally and incompletely, resulting in sub-optimal retrieval performance. In this paper, we propose a novel Multi-Relational Deep Hashing (MRDH) approach, which can fully bridge the modality gap by comprehensively modeling the similarity relationship between data in different modalities. In more detail, to investigate the inter-modal relationships, we constrain the consistency of cross-modal pairwise similarities to maintain the semantic similarity across modalities. Moreover, to further capture complete similarity information, we design a new similarity metric, which we term cross-modal global similarity, by encouraging hash codes of similar data pairs from different modalities to approach a common center and hash codes for dissimilar pairs to converge to different centers. Adopting this approach enables our model to generate more discriminative hash codes. Extensive experiments on three benchmark datasets demonstrate the superiority of our method on cross-modal hashing retrieval.

computer science, artificial intelligence,engineering, electrical & electronic
Linear cross-modal hashing for efficient multimedia search

Xiaofeng Zhu,Zi Huang,Heng Tao Shen,Xin Zhao

DOI: https://doi.org/10.1145/2502081.2502107

2013-01-01

Abstract:Most existing cross-modal hashing methods suffer from the scalability issue in the training phase. In this paper, we propose a novel cross-modal hashing approach with a linear time complexity to the training data size, to enable scalable indexing for multimedia search across multiple modals. Taking both the intra-similarity in each modal and the inter-similarity across different modals into consideration, the proposed approach aims at effectively learning hash functions from large-scale training datasets. More specifically, for each modal, we first partition the training data into $k$ clusters and then represent each training data point with its distances to $k$ centroids of the clusters. Interestingly, such a k-dimensional data representation can reduce the time complexity of the training phase from traditional O(n2) or higher to O(n), where $n$ is the training data size, leading to practical learning on large-scale datasets. We further prove that this new representation preserves the intra-similarity in each modal. To preserve the inter-similarity among data points across different modals, we transform the derived data representations into a common binary subspace in which binary codes from all the modals are "consistent" and comparable. nThe transformation simultaneously outputs the hash functions for all modals, which are used to convert unseen data into binary codes. Given a query of one modal, it is first mapped into the binary codes using the modal's hash functions, followed by matching the database binary codes of any other modals. Experimental results on two benchmark datasets confirm the scalability and the effectiveness of the proposed approach in comparison with the state of the art.
Cross-modal retrieval via label category supervised matrix factorization hashing

Feng Xue,Wenbo Wang,Wenjie Zhou,Tao Zeng,Tian Yang

DOI: https://doi.org/10.1016/j.patrec.2020.08.007

IF: 4.757

2020-10-01

Pattern Recognition Letters

Abstract:Due to the emergence and development of big data, cross-modal hash retrieval has become progressively more important in large-scale multi-modal retrieval tasks depending on its accuracy and efficiency. It completes the retrieval task in a common low-dimensional space by finding a common semantic space for heterogeneous data of different modalities. Recently, many works have concentrated on supervised cross-modal hashing and achieved higher retrieval accuracy. However, there are still many challenges in how to maintain the local geometric structure of the original space in the public space and how to use the supervision information efficiently. To deal with such issues, this paper proposes a hash retrieval method that incorporates supervised information based on matrix factorization (LCSMFH) by maintain the inter-modal and the intra-modal similarity in the original space and make the most of the label information to improve the retrieval task effect. Through experiments on two benchmark data sets, our method is more effective and outperforms state-of-the-art methods. Keywords: Cross-modal retrieval; Matrix factorization; Hash

computer science, artificial intelligence
A High-Dimensional Sparse Hashing Framework for Cross-Modal Retrieval

Yongxin Wang,Zhen-Duo Chen,Xin Luo,Xin-Shun Xu

DOI: https://doi.org/10.1109/tcsvt.2022.3195874

IF: 5.859

2022-12-10

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:In recent years, many achievements have been made in improving the performance of supervised cross-modal hashing. However, it remains an open issue on how to fully explore the data information to achieve fine-grained retrieval performance. Most methods employ logical labels or a binary similarity matrix to supervise the hash learning, losing a lot of useful information. From another point of view, the low expressiveness of dense hash code severely limits its preservation of fine-grained data information. With this motivation, in this paper, we propose a high-dimensional sparse hashing framework for cross-modal retrieval, i.e., High-dimensional Sparse Cross-modal Hashing, HSCH for short. It leverages not only high-level semantic labels but also low-level multi-modal features to construct a fine-grained similarity. In particular, based on two well-designed rules, i.e., multi-level and prioritized, it is able to avoid semantic conflicts. Additionally, it leverages the strong power of high-dimensional sparse hash codes to preserve the fine-grained similarity. Then, it efficiently solves the sparse and discrete constraints of sparse hash codes through an efficient discrete optimization algorithm. In light of this, it is much more efficient and scalable to large-scale datasets. More importantly, the computational complexity of HSCH in the retrieval phase is as efficient as those naive hashing methods that use dense hash codes. Moreover, to support online learning scenarios, this paper also extends HSCH into an online version, i.e., HSCH_on. Extensive experiments on three benchmark datasets demonstrate the superiority of our framework compared with some state-of-the-art cross-modal hashing approaches in terms of both accuracy and efficiency.

engineering, electrical & electronic

Establishment and maintenance of cell suspension cultures.

Discrete Cross-Modal Hashing for Efficient Multimedia Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Frustratingly Easy Cross-Modal Hashing

Nonlinear Discrete Cross-Modal Hashing for Visual-Textual Data

Semantic Consistency Hashing for Cross-Modal Retrieval

Collective Matrix Factorization Hashing for Multimodal Data

Unsupervised Deep Hashing Via Binary Latent Factor Models for Large-scale Cross-modal Retrieval

Online supervised collective matrix factorization hashing for cross-modal retrieval

Sequential Discrete Hashing for Scalable Cross-Modality Similarity Retrieval

MTFH: A Matrix Tri-Factorization Hashing Framework for Efficient Cross-Modal Retrieval

Unsupervised Multi-modal Hashing for Cross-Modal Retrieval

Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval

Online Collective Matrix Factorization Hashing for Large-Scale Cross-Media Retrieval

Cross-Modal Hashing by Lp-Norm Multiple Subgraph Combination

Adaptive Marginalized Semantic Hashing for Unpaired Cross-Modal Retrieval

Large-Scale Supervised Multimodal Hashing with Semantic Correlation Maximization

Multi-Relational Deep Hashing for Cross-Modal Search

Linear cross-modal hashing for efficient multimedia search

Cross-modal retrieval via label category supervised matrix factorization hashing

A High-Dimensional Sparse Hashing Framework for Cross-Modal Retrieval