Abstract:The recent years have witnessed the emerging of vector quantization (VQ) techniques for efficient similarity search. VQ partitions the feature space into a set of codewords and encodes data points as integer indices using the codewords. Then the distance between data points can be efficiently approximated by simple memory lookup operations. By the compact quantization, the storage cost, and searching complexity are significantly reduced, thereby facilitating efficient large-scale similarity search. However, the performance of several celebrated VQ approaches degrades significantly when dealing with noisy data. In addition, it can barely facilitate a wide range of applications as the distortion measurement only limits to ℓ2 norm. To address the shortcomings of the squared Euclidean (ℓ2,2 norm) loss function employed by the VQ approaches, in this paper, we propose a novel robust and general VQ framework, named RGVQ, to enhance both robustness and generalization of VQ approaches. Specifically, a ℓp,q-norm loss function is proposed to conduct the ℓp-norm similarity search, rather than the ℓ2 norm search, and the q-th order loss is used to enhance the robustness. Despite the fact that changing the loss function to ℓp,q norm makes VQ approaches more robust and generic, it brings us a challenge that a non-smooth and non-convex orthogonality constrained ℓp,q-norm function has to be minimized. To solve this problem, we propose a novel and efficient optimization scheme and specify it to VQ approaches and theoretically prove its convergence. Extensive experiments on benchmark data sets demonstrate that the proposed RGVQ is better than the original VQ for several approaches, especially when searching similarity in noisy data.

Robust Iterative Quantization for Efficient ℓ-Norm Similarity Search.

Robust iterative quantization for efficient lp-norm similarity search

Robust Iterative Quantization for Efficient {\unicode{x2113}}-norm Similarity Search

Robust Quantization for General Similarity Search.

Isotropic Iterative Quantization Hashing

Advancing Iterative Quantization Hashing Using Isotropic Prior.

Transformed Residual Quantization for Approximate Nearest Neighbor Search

Approximate Nearest Neighbor Based Feature Quantization Algorithm For Robust Hashing

Norm-Explicit Quantization: Improving Vector Quantization for Maximum Inner Product Search

Improved Residual Vector Quantization for High-dimensional Approximate Nearest Neighbor Search

Optimized Residual Vector Quantization for Efficient Approximate Nearest Neighbor Search

Robust image hashing based on random Gabor filtering and dithered lattice vector quantization.

Equal-Average Equal-Variance Equal-Norm Nearest Neighbor Search Algorithm for Vector Quantization

Hamming Compatible Quantization for Hashing

Anisotropic Additive Quantization for Fast Inner Product Search

Differentiable Optimized Product Quantization and Beyond

Affinity Preserving Quantization For Hashing: A Vector Quantization Approach To Learning Compact Binary Codes

Local Deep Learning Quantization for Approximate Nearest Neighbor Search

Codebook-softened product quantization for high accuracy approximate nearest neighbor search

DisITQ: A Distributed Iterative Quantization Hashing Learning Algorithm

Practical and Asymptotically Optimal Quantization of High-Dimensional Vectors in Euclidean Space for Approximate Nearest Neighbor Search