Abstract:While much progress has been made in mobile visual search, user experiences still relate to the query transmission latency, especially over a bandwidth-constrained wireless link. Low bit rate visual search paradigm has been well advocated in both academic and industrial endeavors, which directly extracts and sends compact visual descriptor(s) rather than sending a query image. Recent advances in compact descriptor design have advocated the use of compressed bag-of-words histogram, which has shown superior performance over other alternatives. However, existing works focus on descriptor compactness, regardless of time cost and memory requirements on the extraction pipeline, which in turn is crucial for the mobile end development. In this paper, we investigate the problem of designing a memory-light descriptor extraction scheme based upon the so-called multi-stage vector quantization. Our scheme starts by quantizing local patches with a small codebook, and the resulting quantization residual is subsequently compensated by a product quantizer. The design of both quantizers are based upon improving PSNR, which would drop a lot through quantization. PSNR is quantitatively shown to be highly correlated with retrieval and matching accuracy. Extensive evaluation on MPEG Compact Descriptor for Visual Search (CDVS) dataset, has reported superior performance over the state-of-the-art.

Efficient Search Procedures for Multi - Stage VQ of LPC Parameters at Low- Rate Speech Coding

Subframe Interpolation Optimized Coding Of Lsf Parameters

Efficient LSP Quantization Algorithm for Very Low Bit Rate Speech Coding

High Efficiency MSVQ for Prediction Linear Spectrum Frequency Parameters with Inter-Frame and Inter-Stage Prediction

A novel hierarchical decomposition vector quantization method for high-order LPC parameters

Mode Based Multi-Stage Vector Quantization with Shared Codebooks

Research on Low Delay Low Bit Rate Speech Coding Algorithm

Multi-Stage Codebook Optimization for LSF Quantization with Inter-Stage Prediction

A CELP-Speech Information Hiding Algorithm Based on Vector Quantization

A Vlsi Architecture for the Hadamard Transform-Based Fast Vq Encoder

Research on real time low bit-rate speech coding

Multi-stage vector quantization towards low bit rate visual search

Sinusoidal excitation LPC vocoder

VQ Image Coding Using Sub-Vector Techniques.

An efficient encoding algorithm for vector quantization based on subvector technique.

Improved Memoryless GMM VQ for Speech Line Spectral Frequencies

Codebook Sharing in Multi-Stage Vector Quantization

Research on Speech Coding Algorithm at Very Low Bit Rate for Narrow-Band Communication

Mode-based Quantization of LP Parameters for Very Low Bit Rate Vocoder

A Low-complexity 4.0 Kb/s Speech Coding Algorithm

Equal-Average Equal-Variance Equal-Norm Nearest Neighbor Search Algorithm for Vector Quantization