Abstract:Many real-world applications require management of uncertain data that are modeled as objects in high-dimensional space with imprecise values. In such applications, data objects are typically associated with probability density functions. A fundamental operation on such uncertain data is the probabilistic-threshold range query (PTRQ), which retrieves the objects appearing in the query region with probabilities no less than a specified value. In this paper, we propose a novel framework called MUD for efficient processing of PTRQs on high-dimensional uncertain data. We first propose a cost-effective pruning technique based on a very simple form of probabilistic pruning information (PPI), namely the probabilistic quantiles. Then we map high-dimensional uncertain objects to a single-dimensional space, where the quantiles of uncertain objects can be indexed using the existing single-dimensional indices such as the B+-tree. Each PTRQ in the high-dimensional space is transformed into multiple range queries on the single-dimensional space and evaluated there. We also discuss a method to optimize the indexing scheme for MUD. Specifically, we formulate a mathematical model for measuring the ''pruning power'' of quantiles, and propose a dynamic programming algorithm which selects the ''best'' quantiles for mapping and indexing. We perform extensive experiments on both synthetic and real data sets. Our experimental results reveal that the MUD framework is both effective and efficient for processing PTRQs on high-dimensional uncertain data, and it can significantly outperform state-of-the-art schemes.

ProMIPS: Efficient High-Dimensional C-Approximate Maximum Inner Product Search with a Lightweight Index

Clustering is Efficient for Approximate Maximum Inner Product Search

FARGO: Fast Maximum Inner Product Search Via Global Multi-Probing.

A Greedy Approach for Budgeted Maximum Inner Product Search

Query-Aware Quantization for Maximum Inner Product Search.

Anisotropic Additive Quantization for Fast Inner Product Search

Efficient Approximate Algorithms for the Closest Pair Problem in High Dimensional Spaces.

Diversity-Aware $k$-Maximum Inner Product Search Revisited

Preserving-Ignoring Transformation Based Index for Approximate k Nearest Neighbor Search

Optimistic Query Routing in Clustering-based Approximate Maximum Inner Product Search

Lazylsh: Approximate Nearest Neighbor Search For Multiple Distance Functions With A Single Index

Exact and Approximate Maximum Inner Product Search with LEMP

Efficient Retrieval with Learned Similarities

PM-LSH

MUD: Mapping-based query processing for high-dimensional uncertain data

Complementary Projection Hashing

Revisiting Wedge Sampling for Budgeted Maximum Inner Product Search

Accelerated Large Scale Optimization by Concomitant Hashing

Efficient Approximate Similarity Search Using Random Projection Learning

An Improved Method of Locality Sensitive Hashing for Indexing Large-Scale and High-Dimensional Features

Packing and Padding: Coupled Multi-index for Accurate Image Retrieval