Abstract:The progress of Internet technology and the portability of mobile communication equipment have provided essential convenience for building an information society. Today, with networked and digital platforms as an important way of socializing, the information carrier is more based on images, videos, etc. The explosive growth of these multimedia data poses a huge challenge to efficient data storage and fast information retrieval. We design an algorithm combining Locality-sensitive Hashing (LSH) and Vision Transformer (ViT) to greatly improve the image matching rate and accuracy, and the algorithm is called ViT-LSH. The principle of LSH is to form the same hash value for points with similar distances in the data set. The results show that the LSH algorithm reduces space consumption and improves query processing efficiency compared with the other five schemes. Therefore, the LSH algorithm can help to quickly get the approximate nearest neighbor query results in a probabilistic manner, thereby ensuring the accuracy of the query results and the efficiency of time and space. The ViT divides the image into fixed-size image blocks ( Patch), uses Linear projection to project the Patch flatten to the specified dimension, gets the Tokens sequence, and adopts the sequence as the input of the feature to realize a new segmentation mode. The ViT does not employ down-sampling so that the image resolution is not reduced. The modeling of global information is a new semantic segmentation mode. The steps of ViT-LSH are as follows: first, preprocess the image, such as denoising, then segment the image, then extract features by ViT, and then reduce features' dimension. The LSH performs hash coding on the image features. After calculating the image's hash code, the image's similarity can be directly calculated by the Hamming distance, sorted according to the similarity, and the matching results are obtained. The experimental results exhibit that ViT-LSH can greatly enhance the efficiency and accuracy of image matching.

Fast Image Retrieval Method Based on Lattice Vector Quantization and Inverted File

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Fast Image Search Using Vector Quantization

Fast Search In Large-Scale Image Database Using Vector Quantization

Color Image Retrieval Utilizing Extended Fast Vq Codeword Search Technique And Vector Composition-Based Feedback

Fast Codeword Search Algorithm for Image Vector Quantization Based on Ordered Hadamard Transform

Index Point Data Using Algebraic Lattice.

Robust image hashing based on random Gabor filtering and dithered lattice vector quantization.

Real-Time Image Semantic Retrieval Based on VQ

Deep Learning of Hash Method for Fast Image Retrieval

Colour image retrieval using pattern co-occurrence matrices based on BTC and VQ

Colour Image Retrieval Based on DCT-domain Vector Quantisation Index Histograms

3D Model Retrieval Based on Vector Quantisation Index Histograms

A Fast Image Matching Algorithm Based on Locality-sensitive Hashing

Image Retrieval Using VQ Index Histograms in Classified DCT Domain.

Rotated Barnes-Wall Lattice Based Vector Quantizer and Its Application in Image-Sequence Coding

Fast codevector search scheme for 3D mesh model vector quantisation

Multipurpose Image Hashing Based On Multistage Vector Quantization

Fast Codebook Design Method for Image Vector Quantisation

Towards Codebook-Free Deep Probabilistic Quantization for Image Retrieval.

A Fast Vector Quantization Encoding Algorithm Based on Adaptive Searching Range and Sequence