Abstract:Dense retrieval models represent queries and documents with one or multiple fixed-width vectors and retrieve relevant documents via nearest neighbor search. Recently these models have shown improvement in retrieval performance and have drawn increasing attention from the IR community. Among a variety of dense retrieval models, the models that employ multiple vectors to represent texts achieve the state-of-the-art ranking performance. However, the multi-vector representation schema imposes tremendous storage overhead compared with single-vector representation, which may hinder its application in practical scenarios. We therefore intend to apply vector compression methods such as Product Quantization (PQ) to reduce the storage cost and improve retrieval efficiency. However, the gap between the original embeddings and the quantized vectors may degenerate retrieval performance. Recently, improved dense retrieval models such as JPQ have been proposed to reduce storage space while maintaining ranking effectiveness by jointly training the encoder and PQ index. They have achieved promising improvement in the single-vector dense retrieval scenario. We therefore try to introduce this joint optimization framework to tackle the storage overhead of the multi-vector models. The key idea is to Jointly optimize Multi-vector representations with Product Quantization (JMPQ). JMPQ prevents effectiveness degeneration by leveraging a joint optimization framework for the query encoding and index compressing processes. We evaluate the performance of JMPQ on publicly available ad-hoc retrieval benchmarks. Extensive experimental results show that JMPQ substantially reduces the memory footprint while achieving ranking effectiveness on par with or even better than its uncompressed counterpart.

Optimal Query Method of Vectorization Actuator Based on Characteristic Analysis of Power Structured Data

An Optimization Method Based on Weighted Least Absolute Value to Restore Power Flow Solvability of Bulk Power System

Optimization method of serial manipulator structure

A Numerical Model Oriented Large-scale Parallel I/O Optimization Method.

New Distributed Spatial Query Optimization Approach by Using Query Analyzer

Vector Spatial Big Data Storage and Optimized Query Based on the Multi-Level Hilbert Grid Index in HBase

Bitvector-aware Query Optimization for Decision Support Queries (extended version)

An Efficient Archerfish Hunting Optimizer (AHO)-Based Power Quality Improvement in Distribution System Connected UPQC

A study of vectorization for matrix-free finite element methods

Maximum Power Analysis Based on Bayesian Inference and Vector Compression Techniques

SpV8 - Pursuing Optimal Vectorization and Regular Computation Pattern in SpMV.

VAPI: Vectorization of Algorithm for Performance Improvement

OPTIMIZATION FOR SPARK MISSION PERFORMANCE BASED ON DATA CHARACTERISTICS

Optimized decomposition and identification method for multiple power quality disturbances

Joint Optimization of Multi-vector Representation with Product Quantization

Studies On Nonlinear Optimal Control For Power Systems: A Constructive Method For Choosing Weighting Matrices

A Quantitative Evaluation of Vector Transcendental Functions on ARMv8-Based Processors

VDTuner: Automated Performance Tuning for Vector Data Management Systems

Fast Encoding Method of Vector Quantization Based on Optimal Subvector Partition

A Survey on Advancing the DBMS Query Optimizer: Cardinality Estimation, Cost Model, and Plan Enumeration

Evaluating the Practicality of Quantum Optimization Algorithms for Prototypical Industrial Applications