Abstract:Bregman distances (also known as Bregman divergences) are widely used in machine learning, speech recognition and signal processing, and kNN searches with Bregman distances have become increasingly important with the rapid advances of multimedia applications. Data in multimedia applications such as images and videos are commonly transformed into space of hundreds of dimensions. Such high-dimensional space has posed significant challenges for existing kNN search algorithms with Bregman distances, which could only handle data of medium dimensionality (typically less than 100). This paper addresses the urgent problem of high-dimensional kNN search with Bregman distances. We propose a novel partition-filter-refinement framework. Specifically, we propose an optimized dimensionality partitioning scheme to solve several non-trivial issues. First, an effective bound from each partitioned subspace to obtain exact kNN results is derived. Second, we conduct an in-depth analysis of the optimized number of partitions and devise an effective strategy for partitioning. Third, we design an efficient integrated index structure for all the subspaces together to accelerate the search processing. Moreover, we extend our exact solution to an approximate version by a trade-off between the accuracy and efficiency. Experimental results on four real-world datasets and two synthetic datasets show the clear advantage of our method in comparison to state-of-the-art algorithms.

An Improved KNN Algorithm Based on Adaptive Cluster Distance Bounding for High Dimensional Indexing

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

Eclipse: Generalizing Knn and Skyline

Efficient index-based KNN join processing for high-dimensional data

Exploring Bit-Difference for Approximate KNN Search in High-Dimensional Databases

Composite Distance Transformation for Indexing and K -Nearest-neighbor Searching in High-Dimensional Spaces

Preserving-Ignoring Transformation Based Index for Approximate k Nearest Neighbor Search

Constrained All-k-Nearest-Neighbor Search

iDistance: An adaptive B+-tree based indexing method for nearest neighbor search

Adaptive Quantization Of The High-Dimensional Data For Efficient Knn Processing

Diagonal Ordering: A New Approach to High-Dimensional KNN Processing.

Indexing High-Dimensional Data in Dual Distance Spaces

BrePartition: Optimized High-Dimensional Knn Search with Bregman Distances

Efficient Data-aware Distance Comparison Operations for High-Dimensional Approximate Nearest Neighbor Search

High-dimensional kNN joins with incremental updates

Hierarchical indexing scheme for fast search in a large-scale image database

Indexing high-dimensional data in dual distance spaces: a symmetrical encoding approach

High dimensional hybrid index based on query sampling

Contorting High Dimensional Data for Efficient Main Memory KNN Processing

Hierarchical Indexing Scheme for Fast Search in Large-Scale Image Database

Fast k-Nearest Neighbour Search via Dynamic Continuous Indexing