Abstract:In this paper, we present a novel indexing technique called Multi-scale Similarity Indexing (MSI) to index image's multi-features into a single one-dimensional structure. Both for text and visual feature spaces, the similarity between a point and a local partition's center in individual space is used as the indexing key, where similarity values in different features are distinguished by different scale. Then a single indexing tree can be built on these keys. Based on the property that relevant images have similar similarity values from the center of the same local partition in any feature space, certain number of irrelevant images can be fast pruned based on the triangle inequity on indexing keys. To remove the “dimensionality curse” existing in high dimensional structure, we propose a new technique called Local Bit Stream (LBS). LBS transforms image's text and visual feature representations into simple, uniform and effective bit stream (BS) representations based on local partition's center. Such BS representations are small in size and fast for comparison since only bit operation are involved. By comparing common bits existing in two BSs, most of irrelevant images can be immediately filtered. To effectively integrate multi-features, we also investigated the following evidence combination techniques— Certainty Factor, Dempster Shafer Theory, Compound Probability, and Linear Combination . Our extensive experiment showed that single one-dimensional index on multi-features improves multi-indices on multi-features greatly. Our LBS method outperforms sequential scan on high dimensional space by an order of magnitude. And Certainty Factor and Dempster Shafer Theory perform best in combining multiple similarities from corresponding multiple features.

Random Projection Tree And Multiview Embedding For Large-Scale Image Retrieval

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Enhanced Micro-structure Descriptor based Image Retrieval.

Feature Representation for 3D Object Retrieval Based on Unconstrained Multi-View

Multiview Inherent Graph Hashing for Large-Scale Remote Sensing Image Retrieval

Large-scale Image Retrieval with Sparse Embedded Hashing

Deep Multi-View Enhancement Hashing for Image Retrieval.

Difficulty guided image retrieval using linear multiview embedding.

Coupled Binary Embedding for Large-Scale Image Retrieval

Multi-Modal Image Retrieval for Complex Queries using Small Codes

Regional Subspace Projection Coding for Image Retrieval.

M-Sne: Multiview Stochastic Neighbor Embedding.

Efficient Indexing for Large Scale Visual Search

Indexing and Integrating Multiple Features for WWW Images

Manifold information through neighbor embedding projection for image retrieval

Exploiting Distribution Constraints for Scalable and Efficient Image Retrieval

Multi-Scale Feature Fusion Based on PVTv2 for Deep Hash Remote Sensing Image Retrieval

Multi-View Object Retrieval Via Multi-Scale Topic Models.

Deep Multiscale Fine-Grained Hashing for Remote Sensing Cross-Modal Retrieval

Multiview Graph Convolutional Hashing for Multisource Remote Sensing Image Retrieval