Abstract:Similarity search is a crucial task in multimedia retrieval and data mining. Most existing work has modelled this problem as the nearest neighbor (NN) problem, which considers the distance between the query object and the data objects over a fixed set of features. Such an approach has two drawbacks: 1) it leaves many partial similarities uncovered; 2) the distance is often affected by a few dimensions with high dissimilarity. To overcome these drawbacks, we propose the k-n -match problem in this paper.The k-n -match problem models similarity search as matching between the query object and the data objects in n dimensions, where n is a given integer smaller than dimensionality d and these n dimensions are determined dynamically to make the query object and the data objects returned in the answer set match best. The k-n -match query is expected to be superior to the kNN query in discovering partial similarities, however, it may not be as good in identifying full similarity since a single value of n may only correspond to a particular aspect of an object instead of the entirety. To address this problem, we further introduce the frequent k-n -match problem, which finds a set of objects that appears in the k-n -match answers most frequently for a range of n values. Moreover, we propose search algorithms for both problems. We prove that our proposed algorithm is optimal in terms of the number of individual attributes retrieved, which is especially useful for information retrieval from multiple systems. We can also apply the proposed algorithmic strategy to achieve a disk based algorithm for the (frequent) k-n -match query. By a thorough experimental study using both real and synthetic data sets, we show that: 1) the k-n -match query yields better result than the kNN query in identifying similar objects by partial similarities; 2) our proposed method (for processing the frequent k-n -match query) outperforms existing techniques for similarity search in terms of both effectiveness and efficiency.

New nearest neighbor affinity similarity function based on separation and compactness between samples

Constrained All-k-Nearest-Neighbor Search

K-Ns: A Classifier by the Distance to the Nearest Subspace.

A New Measurement of Similarity and Related Clustering Algorithm

Reachable Distance Function for KNN Classification

Efficient index-based KNN join processing for high-dimensional data

Preserving-Ignoring Transformation Based Index for Approximate k Nearest Neighbor Search

A Transformation-Based Framework for KNN Set Similarity Search.

A heuristic hybrid instance reduction approach based on adaptive relative distance and k-means clustering

A Fast and Easy Regression Technique for k-NN Classification Without Using Negative Pairs

A split–merge clustering algorithm based on the k-nearest neighbor graph

Lazylsh: Approximate Nearest Neighbor Search For Multiple Distance Functions With A Single Index

K-Nearest Neighbor Intervals Based AP Clustering Algorithm for Large Incomplete Data

Effective and General Distance Computation for Approximate Nearest Neighbor Search

Information Modified K-Nearest Neighbor

Active and Passive Nearest Neighbor Algorithm: A Newly-Developed Supervised Classifier

Nearest-Neighbour-Induced Isolation Similarity and Its Impact on Density-Based Clustering.

Kernel Nearest-Neighbor Algorithm

Efficient Data-aware Distance Comparison Operations for High-Dimensional Approximate Nearest Neighbor Search

Similarity Search: A Matching Based Approach.

An adaptive k-nearest neighbor text categorization strategy