Abstract:Vector quantization has been widely employed in nearest neighbor search because it can approximate the Euclidean distance of two vectors with the table look-up way that can be precomputed. Additive quantization (AQ) algorithm validated that low approximation error can be achieved by representing each input vector with a sum of dependent codewords, each of which is from its own codebook. However, the AQ algorithm relies on computational expensive beam search algorithm to encode each vector, which is prohibitive for the efficiency of the approximate nearest neighbor search. In this paper, we propose a fast AQ algorithm that significantly accelerates the encoding phase. We formulate the beam search algorithm as an optimization of codebook selection orders. According to the optimal order, we learn the codebooks with hierarchical construction, in which the search width can be set very small. Specifically, the codewords are firstly exchanged into proper codebooks by the indexed frequency in each step. Then the codebooks are updated successively to adapt the quantization residual of previous quantization level. In coding phase, the vectors are compressed with learned codebooks via the best order, where the search range is considerably reduced. The proposed method achieves almost the same performance as AQ, while the speed for the vector encoding phase can be accelerated dozens of times. The experiments are implemented on two benchmark datasets and the results verify our conclusion.

Equal-Average Equal-Variance Equal-Norm Nearest Neighbor Search Algorithm for Vector Quantization

Equal-Average Equal-Variance Nearest Neighbor Search Algorithm Based on Hadamard Transform

An Equal-Average Equal-Norm Nearest Neighbor Codeword Search Algorithm for Vector Quantization

Fast Nearest-Neighbor Codeword Search Algorithms for Vector Quantization

Fast Norm-Ordered Nearest-Neighbor Codeword Search Algorithms For Image Vector Quantization

An efficient encoding algorithm for vector quantization based on subvector technique.

VQ Image Coding Using Sub-Vector Techniques.

Fast Search Algorithm for Vector Quantization

Fast Search Method For Image Vector Quantization Based On Equal-Average Equal-Variance And Partial Sum Concept

Performance Comparison Between Equal-Average Equal-Variance Equal-Norm Nearest Neighbor Search (EEENNS) Method and Improved Equal-Average Equal-Variance Nearest Neighbor Search (IEENNS) Method for Fast Encoding of Vector Quantization.

A Fast Vector Quantization Encoding Algorithm Based on Adaptive Searching Range and Sequence

Fast Additive Quantization for Vector Compression in Nearest Neighbor Search.

Edge and Contrast Classified K-means Algorithm for Image Vector Quantizer Design.

Fast codevector search scheme for 3D mesh model vector quantisation

A Fast Full Search Equivalent Encoding Method for Vector Quantization by Using Appropriate Features

Fast Search Algorithm for Vector Quantization Based on the Weighted Squared Error

A Unified Projection Method for Fast Search of Vector Quantization

Efficient codeword search algorithm based on Hadamard transform

Performance Re-Evaluation on "codewords Distribution-Based Optimal Combination of Equal-Average Equal-Variance Equal-Norm Nearest Neighbor Fast Search Algorithm for Vector Quantization Encoding".

Fast Encoding Method for Vector Quantization Based on Subvector Technique with a Modified Data Structure