Abstract:There are a number of component technologies that are useful for visual search, including format of visual descriptors, descriptor extraction process, as well as indexing, and matching algorithms. As a minimum, the format of descriptors as well as parts of their extraction process should be defined to ensure interoperability. In this paper, we study the problem of interoperability among compressed local descriptors at different bit-rates; that is, allowing effective and efficient comparison of compact descriptors, which is fundamentally important to mobile visual search applications. We propose to combine feature transform and multi-stage vector quantization to implement the interoperability of compact local descriptors. First, an orthogonal transform (e. g. Principle component analysis, PCA) is employed to eliminate the correlation between local feature dimensions, which improves the performance of compressed domain descriptor matching with the well-aligned distance computing of sorted important features in transform space. Second, a multi-stage vector quantization (MSVQ) is applied to generate compact codes for local descriptors. At light quantization tables, MSVQ takes advantage of the transform domain features to properly allocate different budgets to each group of transformed feature dimensions, respectively. The interoperability between compressed descriptors at different bit rates can be achieved by the descriptors' fast matching in the orthogonal feature space. In other words, descriptor decoding into the original feature space (SIFT space) is unnecessary, as the distance can be calculated by pre-computed lookup tables. In particular, such efficient matching in transform domain is significant for large-scale visual search. Over a set of benchmark datasets, we have reported superior performance over state-of-the-arts.

Visual Query Compression With Locality Preserving Projection On Grassmann Manifold

Mobile Visual Search Compression with Grassmann Manifold Embedding

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

Compressing Repeated Content Within Large-Scale Remote Sensing Images

Virtual Structured-Light Three-Dimensional Point Cloud Compression with Geometric Reshaping

ViewPCGC: View-Guided Learned Point Cloud Geometry Compression

On The Interoperability Of Local Descriptors Compression

SPCGC: Scalable Point Cloud Geometry Compression for Machine Vision

Multi-View Geometry Compression

Training dataset Preprocessing SIFT descriptor SMPT Grassman Pruning Entropy encoder SIFT descriptor Training Bit Stream

3D-GP-LMVIC: Learning-based Multi-View Image Coding with 3D Gaussian Geometric Priors

Image Compression Using Novel View Synthesis Priors

SceneSqueezer: Learning to Compress Scene for Camera Relocalization

Bilinear Optimized Product Quantization for Scalable Visual Content Analysis.

Fast Point Cloud Geometry Compression with Context-based Residual Coding and INR-based Refinement

A point cloud compression framework via spherical projection

HM-PCGC: A Human-Machine Balanced Point Cloud Geometry Compression Scheme

Revisit Visual Representation in Analytics Taxonomy: A Compression Perspective

Bi-Directional Inter-Prediction For Geometry-Based Point Cloud Compression.

Attribute Compression of 3D Point Clouds Using Laplacian Sparsity Optimized Graph Transform

Multi-stage vector quantization towards low bit rate visual search